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ABSTRACT 

This monograph discusses hov teaching portfolios can 
improve the quality of teaching and learning in higher education. 
Teaching portfolios can be defined as vehicles for documenting 
teaching (with an emphasis on demonstrating excellence), empowering 
professors to gain dominion over their professional lives, providing 
institutions with the means to demonstrate that teaching is an 
institutional priority, and individual i zing faculty development. 
Individual sections provide operational definitions and examples of 
how professors, colleges, and universities use portfolios; 
suggestions for the content of teaching portfolios and how to 
organize them; suggestions for how colleges and universities can 
evaluate the quality of teaching by using teaching portfolios; 
examples of techniques that professors can U3e to gather data about 
their teaching and their students’ learning; and a discussion about 
how higher education institutions might define effective or good 
teaching. Two concluding sections present an analysis of the elements 
of organizational culture that will inhibit the successful 
introduction of teaching portfolios and some of the cultural 
conditions that need to exist for teaching portfolios to flourish, 
and the strategies that department chairs can use to make teaching 
portfolios work in their department. (Contains 142 references.) 
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EXECUTIVE SUMMARY 



New York Governor George Pataki says of SUNY faculty in 
the Rochester Democrat and Chronicle's Libor Day edition: 

“I think they can get more productivity out of the work- 
force.” The story makes it clear that Pataki is talking about 
more hours in the classroom, which he believes translates 
into better learning for students. The newspaper story also 
notes that Ohio recently passed a law requiring college and 
university teachers to spend 10 percent more time in the 
classroom. The sponsor of that law says: “Universities and 
colleges kind of consider themselves above it all, . . . where 
us common folk can’t really comprehend what they do. . . . 
With tuition rising at a tremendous rate, there's got to Ik* 
some rules.” 

Much of this type of criticism is based on misconceptions 
that teaching involves only rhe time spent in the classroom 
and that professors spend very little time teaching. Educators 
must demonstrate that the hours spent in rhe classroom are 
only part of the real work of teaching. One means to this 
end is the teaching portfolio, which can provide professors 
with a vehicle to document the quality and quantity at their 
teaching. 

What Is a Teaching Portfolio? 

Teaching portfolios can be defined in at least four ways by 
focusing on their purpose. First, teaching portfolios are vehi- 
cles for documenting teaching, with the emphasis on dem- 
onstrating excellence (see, e g., O'Neil and Wright 1992). 
Second, teaching portfolios are vehicles that empower pro- 
fessors to gain dominion over their professional lives (see. 
e.g., Seldin 1991). Third, teaching portfolios are vehicles to 
provide institutions of higher learning with tile means to 
demonstrate that teaching is an institutional priority (see. 
e.g.. Braskamp and Ory 1994). Fourth, teaching portfolios 
arc vehicles for individualizing faculty development (see. 
e.g., Seldin 1993b; Shore el al. 1986). 

What Does Higher Education Value? 

The introduction of teaching portfolios requires institutions 
to critically examine what they value, and what institutions 
value is ultimately reflected in their reward structure. Un- 
fortunately. four-year colleges and universities on the whole 
reward research. Until this situation is changed, in actions as 
well as in words, teaching will always take a distant second 
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place to publications, grants, and the other public marks of 
the researcher. "(Itl is futile to talk about improving the qual- 
ity of teaching if, in the end, faculty are not given recogni- 
tion for the time they spend with students’* (Boyer 1990. p. 
xi). A critical first step to recognizing and rewarding good 
teaching is to develop effective ways to assess teaching 
performance. 

The appraisal of performance must be individualized for 
it to ultimately affect teaching (Blackburn and Pitney 1988). 
But "individualization in teaching is threatened by the typical 
way it is assessed, namely, by student evaluations. . . . They 
establish a uniform set of standards and assume that certain 
behaviors are good and Ithatl the absence of those behaviors 
constitutes proof of poor teaching'* (p. 32). Student evalua- 
tions appear to have little impact on the improvement of 
teaching, however (Ory 1991). and something more is 
needed if colleges and universities are serious in their desire 
to improve teaching through performance appraisal. “A port- 
folio system would accomplish the goal of continuous 
growth and development, the realization of the individual's 
full potential'* (Blackburn and Pitney 1988. p. 32). 

What Should a Teaching Portfolio Contain? 

Most portfolios incorporate a statement of the professors 
philosophical beliefs about teaching and learning. Philo- 
sophical beliefs shape, sometimes in subtle ways, human 
behavior. When professors reflect on how a particular read- 
ing. a specific teaching style, or a particular assignment re- 
lates to their philosophy of education, they are examining 
deeply held convictions. Therefore, much of the remainder 
of the portfolio details how professors put their beliefs into 
practice in and out of the classroom. Most important, much 
of the portfolio should he devoted to reflection on how be- 
haviors are congruent with beliefs. Most portfolios also in- 
corporate a plan for altering behaviors found to be incon- 
gruent with the professor's philosophical assumptions about 
teaching and learning. And the portfolio should incorporate 
a strategy to assess the appropriateness and success of the 
new behaviors. 
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llov/ Can Administrators Build Interest? 

Building interest ultimately means managing change — in this 
case, a significant change in the culture of higher education. 




Administrators need to become effective change agents. 
Because of our socialization in graduate education, most of 
us are well steeped in the ‘ traditions" of academe: therefore, 
it can be quite challenging to guide others through changes 
seeking to radically alter that hegemony. If the change is to 
be significant and lasting, administrators should develop 
methods to include most faculty in the process — not simply 
in the product. For many administrators, it means learning 
more about how to implement change, garner support, and 
overcome resistance. 

If the improvement of teaching and learning is the ulti- 
mate goal of a portfolio project, most faculty will want to 
learn how to assess the effectiveness of their teaching and 
students* learning. Although the literature on faculty evalua- 
tion has included references to formative evaluation for some 
time, these references usually fail to include advice on how 
one might go about this vital task of assessment. Although 
many faculty are quite capable of knowing when students 
are not understanding the material, often professors do not 
know how to go about discovering it 'by students are not 
learning. Therefore, the complete portfolio project should 
plan activities intended to help faculty (earn how to assess 
their teaching, their students' learning, and the currency of 
their courses. 

The difference between a faculty evaluation system that 
sup|x>rts faculty and one that demoralizes faculty can he 
found in the care that goes into designing a systematic ami 
cotnprebemitv evaluation system. Evaluation is effective 
when administrators and faculty work together to dev elop 
the instruments and procedures rather than when administra- 
tors impose them on the faculty. Administrators and faculty 
working together should start toy determining the purpose(s) 
of evaluation, who w ill be evaluated, how often, who w ill do 
the evaluating, and. most important, what will be evaluated. 

Department chairs should take great pains to publicly 
connect the outcomes of faculty evaluation to the reward 
system. When the faculty evaluation process demonstrates 
that an individual is a good teacher, chairs must lx* certain 
that the institution rewards the individual. For too long, 
rewards have gone solely to the faculty who excel at re- 
search. Teaching portfolios can provide an effective means 
of recognizing good teaching. And the recognition of good 
teaching is the first step toward adequately rewarding it. 
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FOREWORD 



“Colleges and universities do not place enough emphasis on 
good teaching!” The number of times that critics of higher 
education repeat this thought in newspaper articles, popular 
magazines, and speeches indicates that, to a great number of 
people, this thought contains a great deal of truth. Support- 
ing this belief is the result of recent surveys of faculty ; indi- 
cating that the majority believe research and publishing are 
more highly valued and rewarded than teaching. On the 
other hand, college and university leaders insist that quality 
teaching is their institutions’ most important activity. But if 
it is. why does the opposite perception still persist? The 
answer is that both perceptions are accurate and inaccu- 
rate — mainly because all parties concerned have ignored 
several fundamental realities. 

Several fundamental conditions of human behavior must 
be observed if an organizational culture is to change. 

• The lair of retranl and a( tf free iat ion. People move in the 
direction where they perceive they are most rewarded 
and appreciated for their actions. 

• The lair of surriral. People adjust their actions according 
to how they perceive those actions affect or improve their 
ability to survive . 

• The hue of mine Because teaching is often protected by 
the cloak of academic freedom, it is most often conducted 
without direct observation other than by the teacher and 
the students. Research publications and conference pre- 
sentations. however, are more often conducted in public 
and arc easily seen and counted. 

• The lair of legitimate measurement. f : or measurement to 
have an impact, a consensus must he reached on the 
accuracy or 'legitimacy of that measurement. Because of 
the difficulty in measuring it. the academic profession has 
not developed a consensus on how to define and mea- 
sure “quality teaching." 

By ignoring these laws of human behavior, institutions 
continue to articulate their belief in quality teac hing but 
have rewarded faculty for activities more easily measured — 
which, more often than not, emphasize research and pub- 
lishing. According to one wag, it is a perfect example of in- 
sanity: doing the same thing, the same way. every lime, 
but expecting different results. 
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Some institutions have searched for ways to do things 
differently that would more successfully change the culture 
and increase their emphasis on teaching. One technique has 
been the implementation of teaching portfolios. According 
to John P. Murray, assistant professor of educational adminis- 
tration at SUNY-Brockport, the teaching portfolio takes into 
consideration some of the fundamental laws of human 
behavior: It collects tangible evidence of a faculty member’s 
teaching activities, it creates a focal point to examine and 
evaluate past teaching, and it sets specific goals for future 
teaching activities and performance. Through its use over 
time, the portfolio can develop a record of teaching quality 
and improvement that can successfully compete against the 
measurable qualities of research and publishing. The use of 
the teaching portfolio helps to create greater appreciation 
and reward for an individual's teaching, reinforces and pro- 
mt. . greater effort toward quality teaching, and therefore 
becomes a self-reinforcing process toward the promotion of 
quality teaching. 

Ernest Boyer, in Scholarship Reconsidered: The Priorities 
of the Professorate i 1990), speaks to the importance of rec- 
ognizing the scholarship of teaching. This respect for teach- 
ing as a scholarly activity will never reach parity with pub- 
lishing c. c onference presentations until leaching becomes 
more visible and more measurable. The use of teaching 
portfolios can be one method to help increase a focus on 
the quality and scholarship of teaching and help develop 
tangible evidence that will help give teaching the same 
respect and rewards that are given to other forms of aca- 
demic scholarship. 

Jonathan D. Fife 

Series Editor. 

Professor of Higher Education Administration, and 
Director. ERIC Clearinghouse on Higher Education 
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INTRODUCTION 



This monograph is about how teaching portfolios can im- 
prove the quality of teaching and learning in higher educa- 
tion. Teaching portfolios are a means to improve the state of 
teaching in higher education because they provide educators 
with the scholarly opportunity to study and reflect on the 
teaching and learning processes. Before teaching portfolios 
or any other innovation can take root in higher education, 
however, the prevailing culture of higher education institu- 
tions must be examined and perhaps altered (Shelton and 
DeZure 1993). 

Higher education is increasingly under siege. Critics 
openly question whether higher education serves its stu- 
dents, and many claim that higher education has lost its 
focus on its mission (Dillon and Ueberman 1996; Gardiner 
1994; Lucas 1996; Shelton and DeZure 1993). Some critics 
are fonning powerful alliances with lawmakers, who are 
withholding funding and demanding faculty teach more 
students and more classes and spend more time on campus 
and in the classroom. According to a January 1996 story in 
The Chronicle of Higher Education, 21 states have enacted 
legislation regulating faculty workloads. 

The debate has even reached the national level. The chair 
of the U.S. House Committee on Children. Youth, and 
Families, Rep. Patricia Schroeder. authored a report in 1992 
that states, "When it conies to a college education. American 
families are paying more and getting less, largely because 
the average professor is making $63,000 a year for teaching 
six to eight hours a week" (quoted in Schoenfeld 1992). 

While many of these responses seem punitive and dys- 
functional to educators, they require a response from educ a- 
tional leaders. Most educators, however, either do not re- 
spond or claim that the criticisms arc based on mispercep- 
tions and are therefore invalid. 'File debate over the validity 
of the criticism may go on interminably within the ivied 
walls, but it seems dear that the public wants action now 
and its elected officials are responding. This failure of edu- 
cational leaders to respond effectively only fuels the critics* 
attacks and legislative actions. In New York State, for exam- 
ple. the lack of effective leadership in the SliNY system has 
led lo significantly decreased funding, increased tuition, 
increased control by elected officials, and the resignation of 
a chancellor. A few educational leaders are belatedly coining 
to the “recognition . . . that higher education must change. 
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and, as in other sectors of society, repeated and insistent 
calls have been made for significant, even radical, reinven- 
tion, redefinition, and restructuring- of our industry" 
(Gardiner 1994, p. 145). 

To formulate a clear and decisive response, leaders in 
higher education must increase their awareness of the depth 
and breadth of the problem. Clearly, public and legislative 
criticisms center on the perceived lack of importance placed 
on teaching and the perceived poor quality of much teach- 
ing. Are these criticisms valid? Unfortunately, most colleges 
and universities cannot answer these criticisms. They simply 
do not have the data. Colleges and universities are just now- 
beginning to assess learning outcomes (Gardiner 1994). 
Assessing educational outcomes, however, requires that we 
have an understanding of what they should be, and we do 
not. Assessing the quality of teaching requires that we have 
an understanding of what effective teaching practices are, 
and we do not. 

The truth of the matter is that many teachers could im- 
prove. The good news is that most want to improve. Why, 
then, do we not find teachers working toward becoming 
better teachers? Chief among the varied causes usually 
offered is that teaching is not valued. If we consider only 
financial compensation, there is considerable truth to this 
allegation, but it is only part of the story. Of equal impor- 
tance is that most professors are ill-trained to be teachers. 

Trained only in the technical subtleties of literary. his- 
torical, or scientific research and in man y cases clois- 
tered in libraries or laboratories for yean during their 
graduate training , they may never bare read and 
reflected on the great classics of American liberal edu- 
cation and the history of the American college and 
university, studied the research illuminating their stu- 
dents * developmental psychology . learned the theory 
and practice of modern developmental academic advis- 
ing, read the influential contemporary critical reports 
on higher education, or studied and practiced under 
supen>ision the design and implementation of modern 
instruction. Cast adrift in the profession without chan 
or oar by their graduate school mentors arid new col- 
leagues and lacking the frcrspecluv, personal philoso- 
phy, and basic educational skills reefuisite for 
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professional competence, new faculty sink or swim in 
the classroom and advising conference to the enormous 
detriment of their students and society (Gardiner 1994. 
pp. 142-43). 

When searching for causes for the alleged poor state of 
higher education, it would he easy to oversimplify. While it is 
easy to place the blame on reward structures that favor re- 
search. publications, and grantsmanship over teaching and 
the inadequate teacher training that professors receive from 
graduate schools, the problems of higher education have sev- 
eral causes — not the least of which are the widely accepted 
myths regarding the relationship of the professoriat to the 
task of teaching that form part of the cultural hegemony of 
higher education. “Improving college teaching and elevating 
its status will require changes in the prevailing culture of the 
academy, a culture that has become rigidly entrenched and 
resistant to efforts in modify it. Long-term answers involve 
systemic changes in our institutional culture" (Shelton and 
DeZure 1993, p. 28). Systemic change in higher education 
requires a significant cultural paradigm shift, and for this 
change to occur, educational leaders will need to tackle four 
myths that are deeply embedded in the culture of higher 
education. Unless these myths are challenged, any attempt to 
improve the quality of instruction by the introduction of 
leaching portfolios is likely to fail. 

• Myth *1: All that is required to be a good teacher is a 
thorough knowledge of the discipline. 

• Myth *2: How to teach effectively cannot be taught-, you 
either have it or you don’t. 

• Myth Effective teaching strategies are generic and 
cross all disciplines. 

• Myth #4: Effective teaching can be measured with a 
generic set of criteria. A corollary to this myth is that 
input from students is sufficient to assess the quality of 
teaching. 

Regarding the first myth, most college teachers are well 
educated in their specific discipline or, more often, in a nar- 
row subset of that discipline. Although knowledge of < ie's 
discipline is a necessary condition, it is not sufficient for 
effective teaching. If it were sufficient, most college and 
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university teachers would lie outstanding teachers. Despite 
evidence to the contrary, many college and university teach- 
ers and administrators clearly believe thaL knowledge of the 
material is all that it takes to teach effectively. While know- 
ing the subject matter is important, effective teaching also 
involves knowing how to relate the material to diverse 
groups of students and understanding how to apply the 
material and methods to a wide variety of settings. At the 
present time, few opportunities exist for professors to en- 
gage uctirely in learning about teaching. The creation of a 
teaching portfolio would prov ide such an opportunity. 

Concerning the second myth, the belief that teaching is 
an inborn ability or talent that cannot be taught or learned is 
somewhat bizarre when one considers that higher education 
institutions are in the business of teaching any other skill 
imaginable. To accept this widespread belief is to ignore the 
burgeoning body of research into cognitive psychology and 
how humans learn. Rather than thinking of a teacher as an 
artist with innate talent, it is more productive to think of a 
teacher as a eraftsperson. Craftspeople may have raw talent, 
but they also need to perfect technique for the talent to 
show through. 1'ntil a eraftsperson develops technique, any 
innate talent is likely to he quite useless. In other words, 
although some indiv iduals may find it easier than others to 
be effective teachers, to be effective requires diligent effort. 
Individuals cun learn how to teach better, even already 
good teachers, by diligent study of the teac hing and learning 
processes. The creation of a teaching portfolio would pro- 
vide such an opportunity. 

Like most myths, the belief that effective teaching strate- 
gies cross all disciplines contains a small grain of truth, ‘file 
ways in which disciplines approach their subject matter dif- 
fer significantly, however, and those differences are reflected 
in teaching strategies. This “pedagogy of substance' (Shul- 
man 1993) represents two distinct yet equally important 
images regarding effective teaching. The first is that effective 
teaching requires instructors to “know what will he readily 
understood by students, what will require extra time, and 
what will require a variety of instructional strategies to be 
understood and integrated by different types of learners" 
(Shelton and UcZure 1993. p. 3 T ). For Shulman. this knowl- 
edge is the “wisdom of practice" and requires a comprehen- 
sion of the triangular relationship among students, teacher. 
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and subject matter. The second image is that professors tend 
to look to others. within their own discipline for what they 
value and respect. If teaching is to truly matter, “we need to 
make the review, examination, and support of teaching the 
responsibility of the disciplinary community" (Sluilman 1993. 
p. 6). The creation of a teaching portfolio would provide 
such an opportunity. 

A corollary to the myth that effective teaching can be 
measured with a generic set of criteria is that students' input 
is sufficient to assess the quality of teaching. This myth, per- 
haps the most -invidious of these four, causes colleges and 
universities to develop assessment instruments that speak 
only to a very general set of behaviors that are common 
across all disciplines. Typical teacher evaluation instruments 
for use by students measure teachers' behav iors, such as 
being on time, speaking clearly, being organized, providing 
clear objectives, and giving prompt feedback. Although 
these conditions are often necessary for effective teaching, 
they are not sufficient. A professor can, for example, prov ide 
prompt feedback that is of no assistance to a student, make 
clear objectives that should not he part of a particular 
course, and say it all with great clarity. The assessment of 
teaching requires that professors probe deeper than these 
standardized forms allow'. "When faculty and administrators 
allow student ratings to be the only real source of informa- 
tion about teaching, they unwittingly contribute to a system 
in which too much emphasis is placed on evaluating super- 
ficial teaching skills and not enough is placed on more sub- 
stantive matters' (Keig and Waggoner 199*1. p. 1). Infective 
evaluation of teaching requires that the entire context of the 
teaching and learning equation be studied. The creation of a 
teaching portfolio would provide such an opportunity. 

The culture of higher education will change significantly 
if teaching and learning are to occupy their rightful place at 
the center of the higher education mission. The study of 
teaching and learning will gain the same respect that other 
disciplines have enjoyed. Assessment of the effectiveness of 
teaching must he broadened beyond evaluations by stu- 
dents. and innovative and meaningful ways to assess teach- 
ing and learning will be needed. Professors will need to be 
shown ways of examining and reflecting on teaching and 
learning. Ton few teachers have examined in a systematic 
way how they teach or have thought about it seriously or 
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reflectively" (Keig and Waggoner 1994, p. 7). But “improving 
college teaching should not be a model for remediation; it 
should be a model of ongoing improvement for all faculty, 
something shared with colleagues, and something reinforced 
throughout the learning community" (Shelton and DeZure 
1993, p. 30). It is the contention of this monograph that 
teaching portfolios can satisfy this requirement. 

The successful use of teaching portfolios, however, re- 
quires a substantial change in the prevailing cultures of 
higher education. And such changes will not be successful 
or sustainable without effective departmental leadership. 
Leadership must come from department chairs for several 
reasons, chief of which is that departments are the power 
base of all colleges and universities. Former Stanford Univer- 
sity president Donald Kennedy argued that central adminis- 
trators are relatively powerless to effect change “because the 
action is all peripheral: it takes place at the level of depart- 
ment faculties" (quoted in Zlotkowski 1996, p. 3). 

Moreover, the failure of the generic approaches to im- 
proving teaching can be traced to the fact that they have ig- 
nored the importance of disciplinary differences housed in 
academic departments. These disciplinary differences largely 
disappear when efforts to improve teaching start with the 
department. “We need to reconnect teaching to the disci- 
plines. . . . Like it or not, the forms of scholarship that are 
seen as intellectual work in the disciplines are going to be 
valued more than the forms of scholarship (like teaching) 
that are seen as nondiseiplinary" (Shulman 1993, p. 6). 

When the talk of improving teaching comes from the central 
administration or a center for teaching and learning, faculty 
rarely relate. “Why? The conversation offered them remains 
too distanced from the intellectual excitement and challenge 
faculty feel working in their disciplines. The conversations 
prcxeed as through it didn’t matter what was being taught or 
to whom” (Rhem 1991, p. 2). 

The next five sections provide operational definitions and 
examples of how professors, colleges, and universities use 
portfolios; suggestions for the content of a teaching portfolio 
and how to organize it: suggestions for how colleges and 
universities can evaluate the quality of teaching by using 
teaching portfolios; examples of techniques that professors 
can use to gather data about their teaching and their stu- 
dents' learning; and a discussion about how higher educa- 
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=Sion institutions might define effective or good teaching. The 
S*wo sections after them provide, respectively, an analysis of 
s^the elements of organizational culture that will inhibit the 
successful introduction of teaching portfolios and some of 
the cultural conditions that need to exist for teaching portfo- 
lios to flourish, and the strategies department chairs can use 
to make teaching portfolios work in their departments. 
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WHAT IS A TEACHING PORTFOLIO? 



One of the benefits derived from a teaching portfolio is the 
flexibility it provides individual faculty members, depart- 
ments, and colleges. Consequently, a simple descriptive def- 
inition of the teaching portfolio would be somewhat un- 
desirable. 'Rather than settle on any fixed view of what it' 
is, . . . campuses {should) explore the many images of what 
portfolios might be" (Edgerton. Hutchings, and Quinlan 
199 L p. 4). Moreover, portfolios are "intensely personal 
documents that take on the character of the owner" (J.P. 
Murray 1995b. p. 16-t). Therefore, operational definitions 
that focus on purpose provide the best definitions. 

Operational Definitions 

Teaching portfolios can be defined operationally in at least 
four ways by focusing on their purpose. They can be de- 
fined as vehicles for: 

• Documenting teaching, with the emphasis on demonstrat- 
ing excellence. 

• Empowering professors to gain dominion over their pro- 
fessional lives. 

• Providing institutions of higher learning with the means 
to demonstrate that teaching is an institutional priority. 

• Individualizing faculty development. 



Documenting teaching 

When defining the teaching portfolio, most authors tend to 
emphasize that portfolios are vehicles for documenting a 
pix lessor's tea ch i ng. 

• The goal of a teaching portfolio is to describe through 
documentation o reran extended fieriod of time the full 
range of your abilities as a college teacher ( l rhacli 1 992, 
p. 71). 

• The teaching j portfolio / is a contprehensire record of 
teaching actirities and accomplishments drawn up by the 
profcssoriO'XeW and Wright 1992. p. 6). 

• llhe teaching portfolio is / a document that a faculty mem- 
ber creates to communicate teaching goals, to summarize 
accomplishments . and to cotuvy the quality of teaching 
(Waterman, quoted in Millis 1991, p. 2l~). 
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Moreover, many authors stress the ability of the teaching 
portfolio to illustrate what is best about a professor's teaching. 

• [A teaching portfolio} focuses on the characteristics of 
exemplary' teaching and the best way to document and 
display them (Millis 1991. p. 217). 

• (A teaching portfolio} is a factual description of a professor’s 
major strengths and teaching achievements. It describes 
documents and materials l that} collectively suggest the 
scope and quality of a professor's teaching performance. It 
is to teaching what lists of publications, grants . and honors 
are to research and scholarship (SMin 1991, p. 3). 

• A teaching portfolio is a collection of documents that rep- 
resent the best of one’s teaching and provides one with the 
occasion to reflect on his/her teaching with the same 
intensity professors devote to their research (J.P. Murray 
1994b. p. 34). 

Some argue that the concept of a portfolio should be ex- 
panded to include all the traditional aspects of a professor's 
work (Braskamp and Ory 1994: Centra 1993: Froh. Gray, 
and Lambert 1993). A faculty portfolio is “a comprehensive 
presentation of the works, activities, and achievements of 
faculty in the primary' areas of the academy — teaching, 
scholarly activities, and services, lit is) a holistic portrayal of 
a person's professional capabilities" (De Fillips 1993. p. 11). 

In the attempt to develop a more inclusive portfolio, 
however, the danger exists that teaching will once again be 
eclipsed by accomplishments in research. “For teaching to 
become important again, reputations built on publishing, 
scholarship, and research grants will have to he recast to 
showcase teaching" (Meacham 1993. p. 43). The real power 
of the portfolio resides in its potential to place teaching at 
the forefront of higher education. 

Empowering professors 

A second major thread running through the definitions of 
teaching portfolio is its potential to allow individual instruc- 
tors to document "both the complexity and the individuality 
of good teaching" (Seldin 1991, p. xi). Portfolios afford fac- 
ulty the “opportunity to define how they want to develop 
and assess pedagogical ••kills, command of subject matter, 
and professional skills” ^..P. Murray 1994a. p. J). 
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^•• 7 he portfolio developer decides what goes into the portfolio. 
±=:: He/she states his/her teaching philosophy . how that is to he 
. . put into action . what the proper student outcomes should 
he , and. most [ important J, what standards of success 
he/she will he judged against. The teacher becomes the 
professional educator that standardized evaluation often 
militates against {yv. Murray 1994b, p. 36). 

• [The teaching portfolio I could encourage faculty to focus 
specifically on self-selected instructional variables as they 
prepared their materials. Ihrough the process of establish- 
ing goals and selecting evidence to document It hat} these 
goals had been met. faculty irould be encouraged to 
improve their teaching as well as to vehfy current effec- 
tiveness (Fayne 1991, pp. 4-5). 

• The teaching portfolio is a tool for examining the concrete 
evidence of one 's teaching and reflecting on what it says 
afxntt one’s teaching and the student 's learning. . . . 'The 
process of introspection used in the development of a port- 
folio enables faculty to rejlect upon and assess their teach- 
ing practices against their values and beliefs and to 
communicate teaching accomplishments to others (“ The 

— Teaching Portfolio” 1994, p. 1). 

: • Teaching portfolios can hat e a special power to involve 
faculty in reflection on their own practice ( Fdgerton, 
Hutchings, and Quinlan 1991. p. 6). 

_• The portfolio process empowers faculty to access and itn- 
ri prove their performance. . . . Empowered faculty feel: ( 1) 
driven to teach well ftecause of intrinsic motivation rather 
than chair evaluations, and (2) that their teaching perfor- 
mance is primarily in their own hands (Shulman and 
Rhodes 1995. p. 1). 

Demonst rating teaching as an institutional priority 

The third major theme in the definitions of teaching portfo- 
lios revolves around their ability to emphasize teaching as 
an institutional priority. When a campus encourages its fac- 
ulty to develop teaching portfolios, the entire campus en- 
gages in “a dynamic process Ithatl. at the institutional level, 
opens campus dialogue on academic excellence" (De Fillips 
1993, p. 11). 

While colleges and universities often intend to use portfo- 
lios to emphasize the importance of teaching and learning, 
many soon recognize the portfolio s value for faculty dcvel- 
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opment (Kraskamp and Ory 1994). 'While many institutions 
initially adopted and promoted portfolios to gather more evi- 
dence to increase the status of teaching on their campuses, 
many institutions now conclude that its greatest potential 
may he in the area of faculty development" (p. 231). 

Individualizing faculty development 

'Die fourth theme found in the definitions of teaching port- 
folios stresses, in fact, their potential to motivate faculty 
development. 

• llhe portfolio isj a carefully assembled collection of “ work 
samples" and reflective comment l that I has emerged as an 
effective vehicle for faculty to document what they know 
and do as teachers , while also promoting individual 
reflection and improivment (.“Use of Faculty Portfolios" 
1993, p. 4). 

• (The portfolio J is a gathering of documents and other 
materials highlighting the professor 's classroom teaching 
and suggesting its scofx* and quality. ... It is J legible 
enough to be used . . . to provide stimulus and structure 
for self- reflect ion about teaching areas in need of improve- 
ment (Seldin 1993b. p. xi) 

• The course portfolio fogitis the process of improvement by 
engaging in the scholarship of teaching, a strategy of criti- 
cal inquiry into teaching performance in a single course, 
a starting point for better teaching all around (Zubizarreta 
1995. p. 3>. 

One author found the value of developing a portfolio in its 
requirement to identify and challenge his basic assumptions 
about teaching and learning. 

Careful and rigorous introspection in asking oneself 
"why do I do rvhat l do in my teaching function?" is es- 
sential. As / considered this (piestion and others. I 
found my focus turning to issues of student learning. 

’/hat is , I found my teaching was based on models l bad 
constructed from observations of the best teachers from 
m y past. My assumption was that if those models of 
teaching were effective for my learning, those same 
models would fre effective for my students. In fact, o tie 
of the most important functions . . . is to continually 
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remind the preparer to challenge implicit assumptions 
that have developed over many years of teaching (Ferry 
1993, p. 16). 

In reality, teaching portfolios are all of the above. They 
are a means to document teaching, to showcase excellence 
in teaching, to emphasize that teaching is paramount to the 
mission of higher education, and to motivate faculty devel- 
opment. “Properly done, the portfolio will provide an accu- 
rate picture of a faculty member's current accomplishments 
and status, as well as plans for improvement. . . . The qual- 
ity of thought and effort one brings to the teaching enter- 
prise will be revealed" (Perry 1993, p- 17). 

These themes, however, do reveal a creative tension 
among the various reasons offered for encouraging faculty 
to develop a teaching portfolio. The notions that portfolios 
should be manifestations of the institutional importance 
placed on teaching and displays of one's best work seem- 
ingly conflict with the notion that they are documents for 
personal and professional development. On the surface, it 
would seem that the room needed to reflect on one's teach- 
ing — room to experiment and to fail — is not found within 
the definitions that stress showcasing good teaching. In fact, 
two distinct varieties of portfolios could be emerging from 
the literature. 

One emphasizes the portfolio as a file, box, or dossier 
that portrays "best" work, defined as ideal, //airless 
performance. The second sees the portfolio as an expla- 
nation and argument related to tough teaching chal- 
lenges land I goals l that l reflect I si experimentation, 
failures, and successes. . . . fill includes . . . pedagogical 
reasoning — the “ thinking behind " the teaching perfor- 
mance ( Braskamp and Ory 1994. pp. 228-29). 

Yet the apparent conflict among these strands is more illu- 
sory than real, because teaching portfolios “provide a con- 
nection to the contexts and personal histories of real teach- 
ing and make it possible to document the unfolding of both 
teaching and learning over time' (Wolf 1991. p. 129). they 
can sen e diverse purposes. 

The resolution of this apparent conflict can be found in 
the determination of how the portfolio is to be used. 'A 
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faculty member preparing a portfolio for review by a tenure 
committee might design a portfolio that looks quite different 
from one designed by a faculty member who is simply inter- 
ested in taking a hard look at his or her teaching" (J.R 
Murray 1994b, p. 38). Faculty need, however, to ascertain 
how the teaching portfolio is to lx* used before sharing it 
with administrators or colleagues. A faculty member who 
assumes that the portfolio will be used to improve teaching 
may willingly reveal weaknesses that would harm his or her 
chances to gain merit pay. tenure, or promotion. Penalizing 
a faculty member for honest reflection would be a sure way 
to destroy the spirit of cooperation needed for the use of 
portfolios to succeed on campus. 

Why Teaching Portfolios? 

By the beginning of the 1990s. between 50 and ~5 campuses 
had implemented teaching portfolios (Seldin and Annis 

1990. p. 197): five years later. 750 colleges were using them 
(Seldin 1995). The reasons for this phenomenal growth are 
many: "(a) it is cost-effective: (b) it is rooted in the context 
of discipline-related teaching: (c) it debunks the myth that 
effective teaching cannot be documented: (d) it gives faculty 
ownership of the portfolio process, building on intrinsic 
motivation; and (e) it capitalizes on the power of construc- 
tive consultation to generate meaningful change" (Millis 

1991. p. 217). In addition: 

1. Portfolios capture the complexities of teaching. 

2. Portfolios place the responsibility for evaluating teaching 
in the hands of faculty. 

3. Portfolios can prompt more reflective practice and 
improvement. 

i. Portfolios can foster a culture of teaching and new dis- 
course about it (Fdgerton. Hutchings, and Quinlan 1991 ). 

Putting a teaching portfolio together can result in several 
outcomes. Portfolios can assist a professor to: 

l Identify specific duties if a course and hair such respon- 
sibilities Jit into the professor 's teaching load and other 
assignments; 

J. Articulate a philosophy for a particular course: 
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3. Describe \ analyze . evaluate course materials, meth- 
ods . outcomes: 

4. Examine course objectives at id competencies: 

5. Study student and peer reviews and formulate an action 
plan for improvement: 

6. Posit specific teaching goals: 

7. Provide supportive documentation of [jerformauce 
(Zubizarreta 1995. p. 3). 

The authors of these publications tout the ability of port- 
folios to place the responsibility for assessing and improving 
teaching in the hands of the faculty. Teaching portfolios 
derive their potency from this ability to place control in the 
hands of professionals. Teachers can define themselves in 
ways that show their individuality, the richness of their 
teaching, and the values that guide their teaching. "A portfo- 
lio also embodies an attitude that assessment is dynamic and 
that the richest portrayals of teacher (and student) perfor- 
mance are based on multiple sources of evidence collected 
over time in authentic settings" (Wolf 1991, p. 130). At the 
same time, faculty can clearly connect with the specific tradi- 
tions and missions of their disciplines and institutions. In 
other words, teaching portfolios allow one to capture the 
depth and richness of teaching in ways that standard, 
computer-generated and -scored forms cannot. 

Uses for Teaching Portfolios 

Although educators came somewhat late to the concept of 
portfolios compared to other professionals, suggestions for 
their potential use are numerous. Four uses are possible 
from the perspective of the faculty member: 

1. Receiving credit for effective teaching 

2. Improving teaching performance 

3. Receiving awards or merit pay for outstanding teaching 

4. Obtaining a different position (Seldin 1991). 

Several authors (Hraskamp and Ory 199^: Centra 1993: 
Froh, Gray, and Lambert 1993) advocate the use of portfo- 
lios throughout a professor's entire career, 'fable I suggests 
that portfolios can be used in different ways at different 
times in one s career. 
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TABLE 1 




Scholars’ Use of Portfolios at Various Stages 
In the Academic Career 

Purpose of Portfolio 

Stimulate the collection of 
artifacts pertaining to leaching 
and research 

Promote reflection about initial 
teaching and other professional 
experiences 

Encourage discussion about 
professional activities with 
faculty mentors 

Stimulate thinking about a 
philosophy of teaching and a 
future research agenda 

Assisi in the academic job hunt 
facilitate promotion review 
facilitate tenure review 

Encourage discussion about 
professional growth with 
colleagues, department chairs, 
and deans 

Encourage reflection about 
professional growth throughout 
one's academic career 

I Source- Adapted from froh. (hay. and Lambert IW.V p 10S 

Summary 

leaching portfolios are best defined operationally — that is. 
according to their intended purpose. Portfolios have been 
used to document teaching with an emphasis on demon- 
strating excellence, to empow er professors to gain dominion 
over their professional lives, to provide colleges and univer- 
sities with the means to demonstrate that teaching is an insti 
tutional priority, and to individualize faculty development. 

I 'ndouhtedly. academics will use portfolios in all these ways 
and others not yet conceived: however, the two fundamenta 
uses of portfolios are for the improvement of teaching and 
for personnel decisions. 

Within these two purposes are the seeds of a potential 
conflict. "When portfolios are used for personnel decisions. 




Stage 

Earlv Graduate School 



Late Graduate School 



I'lvtenure Years 



Post-tenure Years 
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the portfolio maker may he penalized for honest reflection 
on perceived weaknesses. In most personnel procedures, 
faculty need to emulate their students and attempt to hide 
their weaknesses from the judgmental authorities” (J.P. 
Murray 1994b. pp. 37-38). But the conflict need not occur if 
one determines the purpose of the portfolio before begin- 
ning to dev elop it. Clearly, a portfolio developed for the 
improvement of teaching will look quite different from one 
developed to win promotion, tenure, or merit pay. 

What does all this mean for the teacher? Fundamentally, 
teaching portfolios provide faculty with the opportunity to 
display their teaching abilities and accomplishments. Simply 
documenting one's teaching, however, would neither justify 
the effort required to put a portfolio together nor unleash its 
powerful potential to improve ones teaching. The power of 
a portfolio is its ability to allow a professor to reflect on the 
true task of education — teaching. 
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WHAT GOES INTO A TEACHING PORTFOLIO? 



The content of a teaching portfolio depends largely on its 
intended use. with the two most frequent uses to make per- 
sonnel decisions and to improve teaching. Although both are 
legitimate purposes, a genuine tension exists between the 
summative and formative uses for teaching portfolios. While 
many (Blackburn and Pitney 1988; Centra 1993; Edgerton, 
Hutchings, and Quinlan 1991; Seldin 1991) believe both func- 
tions are compatible, others have reservations, fearing that 

. . . when portfolios are used for personnel decisions, the 
portfolio owner will he penalized for honest te fleet ion on 
perceived weaknesses. . . . The complexity of this dilemma 
revokes around the implicit promise that compiling a 
portfolio tt ill improi e the quality ■ of instruction. Present- 
ing only one's best work would hardly occasion reflection 
on needed changes in one's teaching. Yet. when the 
stakes are high (eg., tenure A revealing one's own imper- 
fections becomes risky business (j.P. Murray 1994b. p. 38). 

Although an anonymous reviewer of this monograph 
suggested that this fear is overstated, the danger exists that 
those skilled at creating the appearance of quality when it 
does not exist could deceive promotion and tenure commit- 
tees. Not all academics have polished communication skills, 
and some faculty believe that a colleague has gained a pro- 
motion or tenure by turning in a ' pretty but empty pack- 
age." The same anonymous reviewer noted, however that 
the solution to this dilemma is to require portfolios that are 
to be used in promotion and tenure decisions to conform to 
the same standards. These standards would include the 
required contents, the order of presentation, the maximum 
size the portfolio can be. what documentation must be 
included in the appendices, and so on. 

Planning the Portfolio 
First questions 

Regardless of whether a portfolio will be used for summa- 
tive or formative purposes, professors must answer some 
fundamental questions about its scope and breadth. Should 
the portfolio contain representative samples or only exam- 
ples of one’s best work? Will the portfolio contain everything 
or only representative artifacts of what one has compiled for 
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a course or term? Should it contain reflections on what the 
artifacts say about a faculty member* s teaching? The consen- 
sus is that "the well-developed portfolio presents selected 
information" (Seldin 1992, p. 14) and “written reflections on 
the significance of the artifacts and events of classroom life" 
(Wolf 1991, p. 131). 

An unorganized collection of artifacts is unlikely to pro- 
vide insights into a professor s beliefs about teaching. Even 
selected documents and artifacts are unlikely to yield in- 
sights into how belief permeates practice unless the faculty 
member reflects on what they mean and how the artifacts 
demonstrate what faculty believe about teaching and learn- 
ing. A mere collection of reflective essays is likely to “place 
greater emphasis on what teachers say they do in their class- 
rooms than on what they actually do" (Wolf 1991. p. 132). 
Thus, a useful portfolio would be an organized set of arti- 
facts generated during the process of teaching and reflec- 
tions on how the artifacts reflect the scope and quality of a 
professor s reaching. 

Organizing principles 

Before one can decide what actually goes into a portfolio, 
one must decide how to organize it. To prov ide a coherent 
and meaningful view of a faculty mcmlx.T*s teaching, a port- 
folio needs to have an appropriate layout for presenting the 
data and reflections. The organizational pattern depends on 
how the teaching portfolio is to be used and the needs of the 
faculty member. If the leaching portfolio is to be used for 
formative purposes, the content and organization should be 
flexible. If the portfolio is to become part of the data used for 
a summarive evaluation, however, the organizational pattern 
and content should be standardized across the institution. 

Several means of organizing teaching portfolios have 
been suggested. For example, a portfolio organized 

. . . around a theme extracted from one 's philosophy of 
education and one's basic beliefs about the learning 
and teaching process becomes a thematic document 
that can prompt reflection on hoir one s teaching 
choices match one s beliefs about teaching. * the empha- 
sis is on fusing our beliefs about the learning/teaching 
process with methods . outcomes, and evaluation (J.R 
Murray 199 ib. p. 3S). 
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Faculty members should 



. . assemble those artifacts of their fires that demon- 
strate where they hare been and what has been ac- 
complished. Voe faculty member uvnld then draw up a 
plan of where he or she wants tog o in both the short 
run and over the long haul, both being subject to alter- 
ation . especially the tatter, as time passes. Next a j'aculty 
member would delineate what is needed to get from her 
or his current stage to the next one and what will con- 
stitute evidence that the new stage has lx*en reached 
(Blackburn and Pitney 1988, p. 33). 

The first organizing principle calls for a deep, them High 
assessment of both a teacher's belief system and practices to 
see how well they match, the second for an assessment of 
past practice that can be used to improve the future. Thus, a 
portfolio becomes more than a “container into which mam* 
different ideas can be poured" (Edgerton. Hutchings, and 
Quinlan 1991. p. 4). A common thread will be woven through 
their diverse content. Teaching portfolios will all address what 
the portfolio owner believes is critical to teaching his or her 
students well, l iie thread will be woven throughout a reflec- 
tive dialogue-— "both internal and external— about who, why. 
and what we are teaching. The process of developing a port- 
folio will force the professor to reflect not only on what he or 
she teaches, but also on why he or she teaches. 

These organizing principles are somewhat abstract and phil- 
osophical and may need to lx* made a bit more concrete and 
practical for some faculty members. On the more practical side, 
the artifacts could be oiganized around their three sources: ( 1 ) 
materials from oneself, (2) materials from others, and (3) the 
products of good teaching (Seldin 1991. 1993b: Shore et al. 
1986). The materials could be sorted into four sections. 

The Jhst part would comprise a collection of materials 
that demonstrate what the faculty member has been 
doing and what she or he has accomplished in teaching 
. . . during the evaluation period. ‘The second part 
would he a plan outlining the faculty member's goals 
and specific object Ives Jhr the next evaluation period as 
well as a more general explanation of plans for the long 
term, hi part three, the faculty member would describe 
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the kinds of support that he or she will need to reach 
short- and long-term goals. The fourth pad would 
describe the evidence that demonstrates these goals hare 
been reached (Han 1989, pp. 2-3). 

A portfolio could also he arranged around the following 
seven dimensions: 

1. What you teach: 

2. How you teach; 

3. Change in your teaching: 

-4. Rigor in your academic standards; 

5. Students' impressions of your teaching and their learning; 

6. Your efforts to develop your teaching skills; 

7. Assessments of your teaching by colleagues U rbach 
1992). 

Yet another suggestion centers the teaching portfolio around 
six themes: 

1. What one teaches: 

2. Whom one teaches: 

3- Why one teaches them: 

-t. How one's philosophy of education influences the 
design of courses and the choice of teaching strategies; 

3. An assessment of one's effectiveness as a teacher: and 
6. A plan for improving one's effectiveness (J.P. Murray 

19951)). 

These four suggested configurations can all be used prof- 
itably to organize one's artifacts and reflections. To be future 
oriented, however, teaching portfolios need to include a 
section on plans to improve one's teaching (Hart 1989: J.P. 
Murray 1995b). 

Content 

After the faculty member decides on an organizational de- 
sign, the next question is what to include. Although the pur- 
pose for writing the teaching portfolio might dictate the 
content if improvement of one’s teaching is the ultimate 
goal, some items are more effective than others (see table 2). 

Tables 3. and 5 present more detailed suggestions about 
what items might he included in a portfolio The actual con- 
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TABLE 2 



The Effectiveness of Items in a Portfolio for the 
Improvement of Teaching 

Especially Effective 

• Representative course syllabi 

• Statement of teaching responsibilities and brief description of 
the way each course was taught anti why 

• Student ratings 

• Description of curricular revisions, including new course 
projects, materials, class assignments 

Somewhat Effective 

• Students' scores on pre- and postcourse examinations 

• A discussion of teaching goals for the next five years 

• Statements from colleagues who have observed the professor 
in the classroom 

• A videotape of the professor leaching a typical class 

Less Effective 

• A statement by the department chair assessing the professor's 
teaching contribution to the department 

• A record of students who succeed in advanced study 

• Statements by alumni on the quality of instruction 

Source: Sdtlin 1991. 



tent, however, should depend to a great extent on the person 
creating it and his or her purpose. These three tables are 
only general lists of what might lx: included, not what must 
be included, but faculty should recognize which items might 
give a more favorable impression of teaching competence 
and which might better be used for self-evaluation and im- 
provement. The portfolio should be compiled to make the 
best possible case for effective teaching f Shore et al. 1986). 

Parts of a Typical Portfolio 

The table of contents for a typical leaching portfolio might 
look like the following: 

1. Philosophy of education — assumptions about how learn- 
ing takes place; 

2. Statement of teaching responsibilities; 

3. General goals; 

4. The match between teaching strategics selected and 
philosophy and general goals; 
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TABLE 3 

Items for Possible Inclusion In a Teaching Portfolio 



What Is Taught 

• List of courses taught 

• Description of grading standards 

• Reflections on the goals of each course — that is. is the 
emphasis on content or critical thinking skills? 

Who Is Taught 

• Students' characteristics (.majors or nonmajors, lower division, 
upper division, graduate) 

• Students' learning styles 

• Motivation for taking the course 

Why They Are Taught 

• Students' goals 

• Institutional mission related to course goals 

• Departmental goals 

• A statement of the essential content of the course — that is. a list 
of cognitive knowledge, skills, and or attitudes 

Documentation of Teaching Strategies 

• Examples of assignments and exams 

• Techniques used to assess students' learning styles 

• Course materials prepared for students 

• A list of leaching strategies used 

• A statement about how assignments and exams reflect the 
faculty member's goals 

• Classroom research techniques used to assess students' learning 



5. Documentation of teaching effectis eness/reflcctKMi: 

6. Summary of outcomes from previous renewal plans (if 
this is not the first portfolio); 

T. A renewal plan, based on information gained during the 
process of compiling the portfolio. 

Philosophy of education 

The only essential component of the leaching portfolio is a 
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Assessment of Teaching Effectiveness 

• Pie- and post -lest scores 

• Student evaluations 

• Notes or other testimonials from students or former students 

• Interview survey data from students who have completed the 
elass 

• When the course is a prerequisite, statements from those who 
teach the following courscls) 

• Teaching awards won 

• Reports from students' employers 

• Review of video audio tapes 

• Scores on standardized national or departmental exams 

• Annotated copies of representative graded papers, projects, and 
exams 

• Statements from colleagues who have visited classes 

• Statements from colleagues who have reviewed syllabi and 
course materials 

• Statements from alumni 

• Statements from administrators who have visited the professor's 
classes 

Teaching Improvement Plan 

• Student evaluations from a prev ious term compared to a 
current term 

• A list of readings on improving teaching and changes resulting 
from reflection on them 

• A record of changes that result from self-reflection 

• A record of on-campus faculty development activities attended 

• Contributions to professional journals that deal with teaching 
improvement 

• A description of new teaching strategies tried 

>o//rce. J.l*. Murray |WSp. p. |~|. 



statement of wluit ihe author believes about teaching and 
learning. It has been called a philosophy of teaching or edu- 
cation (J.P. Murray 199 lb, 1995b: O'Neil and Wright 1992). a 
“framing statement" <De fillips 1993). and a self-assessment 
or reflective statement of teaching goals (Hraskamp and Ory 
199-t: Davis 1993: 1‘roli, Gray, and Lambert 1993). 

Whatever it is called, faculty must examine the implicit 
and explicit assumptions they hold about teaching in order 
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TABLE 4 

Items for Possible Inclusion in a Teaching Portfolio (Part ; 



The Products of Good Teaching 

1. Students' scores on teacher-made or standardized tests, 
possibly before and after a course lias been taken as evidence 
of learning 

2. Students' laboratory workbooks and other kinds of workbooks 
or logs 

3. Students' essays, creative work, and project or field-work 
reports 

•t. Publications by students on course-related work 
3. A record of students who select and succeed in advanced 
courses of study in the field 

fi. A record of students who elect another course with the same 
professor 

Evidence of effective supervision of honors, master’s, or Ph.l). 
theses 

8. Hvidence of setting up or running a successful internship 
program 

9. Documentary evidence of the effect of courses on students' 
career choices 

10. Documentary evidence of help given by the professor to 
students in securing employment 

1 1. Hvidence of help given to colleagues to improve teaching 

Material from Oneself 

This category includes descriptiv e material on current and recent 
teaching responsibilities and practices. 

12. List of course titles and numbers, unit values or credits, and 
enrollments with brief elalxiration 

13. List of course materials prepared Ibr students 
1 Information on your availability to students 

13. Report on identification of students' difficulties and encour- 
agement of students' participation in courses or programs 
l(i. Description of how films, computers, or other nonprint 
materials were used in teaching 

r. Steps taken to emphasize the interrelatedness and relevance 
of different kinds of learning 

Description of Steps Taken to Evaluate 
And Improve One's Teaching 

18. Maintenance of a record of the changes resulting from self- 
evaluation 

19. Hvidence of having read journals on improving teaching and 
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attempted to implement acquired ideas 

20. Re\’iew of new teaching materials for possible application 

21. Exchange of course materials with a colleague from another 
application 

22. Research on one's own teaching of the course 

23. Involvement in an association or society concerned with the 
improvement of teaching and learning 

2*. Attempts to use instructional innovations and evaluate their 
effectiveness 

25. l\se of general support services, such as the Educational 
Resources Information Center, in improving one's teaching 

26. Participation in seminars, workshops, and professional 
meeiings intended to improve leaching 

2~. Participation in course or curriculum development 

2R. Pursuit of a line of research that contributes directly to 
teaching 

29. Preparation of a textbook or other instructional materials 

30. Editing or contributing to a professional journal on teaching 
one's subject 

Information from Others 

St tn fonts 

31. Course and leaching evaluation data that suggest improve- 
ments or produce an overall rating of effectiveness or 
satisfaction 

32. Written comments from a student committee to evaluate 
courses and provide feedback 

33. I nstructured (and possibly unsolicited) written evaluations by 
students, including written comments on exams and letters 
received after a course has been completed 

3-t. Documented reports of satisfaction with out-of-class contacts 

35. Interview data collected from students after completion of a 
auir.se 

3<>. Honors received from students, .such as being elected "teacher 
of the \ear" 

Colleagues 

3". Statements from colleagues who have observed leaching as 
members of a teaching team or as independent observers ot a 
particular course, or who teach other sections of the same 
course 

3 H. Written comments from those who teach courses for which a 
particular course is a prerequisite 
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TABLE 4 (continued) 



39. Evaluation of contributions to course development and 
improvement 

•iO. Statements from colleagues from other institutions on such 
matters as how well students have been prepared for 
graduate studies 

-i 1. Honors or recognition, such as a distinguished teacher award 
or election to a committee on teaching 
Requests for advice or acknowledgment of advice received 
by a committee on teaching or similar body 

Other Sources 

*3- Statements about achievements in teaching from 
administrators at one s own institution or from other 
institutions 

i t. Alumni rating* or other graduate feedback 
-n. Comments from parents of students 
16. Reports from employers of students 
C. Im itations to leach for outside agencies 
-18. Invitations to contribute to the literature on teaching 
i9. Other kinds of invitations based on ones reputation as a 
teacher (for example, a media interview on a successful 
teaching innovation) 

Source: Si lore el al. 1980. 



to reflect on what they believe about the teaching and learn- 
ing process. They "'ill need to deal with some (but certainly 
not all) of the following assumptions: 

• Beliefs about who can and who should benefit from a 
college education; 

• Beliefs about the function of higher education in out- 
society — is it to train or to educate? 

• Beliefs about how people learn; 

• Beliefs about the best way to teach and whether they can 
or even want to adjust their teaching style to accommo- 
date div erse learning styles. 

• Beliefs about their discipline and its importance to their 
students’ future's. 

Kvciything else that goes into the portfolio should some- 
how support these beliefs. The primary value of a teaching 
portfolio derives from the insights faculty gain into their be- 
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^liefs alxnit how and why others learn. What one believes mo- 
tivates how he or she acts. II one's belief system is incon- 
gruent with her or his lx:havior, it will be difficult to lx_* an 
effective teacher. For example, a professor who believes that 
college should be only for those who have proven themselves 
capable of learning will likely have great difficulty teaching in 
a community college whose policy is open-door admissions. 
Taking time to state their beliefs about teaching and learning 
forces teachers to make explicit their pedagogical values. 

Uv writing their philosophy of education, faculty will 
make explicit their values, which will instruct teachers on 
what they believe about how and why students learn. What 
one believes often influences in subtle ways what one does 
and says. If faculty believe that students need to be moti- 
vated by fear of the dreadful consequences that will accrue 
from not learning, they are likely to design draconian assign- 
ments and tests to induce fear in their students. If they be- 
lieve that students learn best when gently prodded, they are 
likely to design their materials quite differently. 

Statement of teaching responsibilities 

~ This section of the portfolio simply describes the courses 
and number of sections taught, enrollment in each, and level 
of classes (undergraduate lower division, undergraduate 
upper division, and so on). At multicampus institutions, 
faculty might want to note the location of the classes. 

General goals 

A statement of the teacher's general goals for his or her 
course(s) and how they blend with one s philosophical 
assumptions might follow the discussion of philosophy. For 
most, goals will be connected to the specific course, the 
demands of the discipline, the connection of the course to 
the overall curriculum, and. one hopes, the needs of stu- 
dents. All of these factors affect how and what a professor 
teaches. This section might also include some reflection on 
what faculty members want students to know or be able to 
do. Faculty might reflect on whether they believe the course 
content, the discipline s methodology, or critical thinking 
skills form the essence of what they want students to learn. 

A professor's reflections undoubtedly will depend on who 
is taught and why they are taught. Teaching should he highly 
situational. Much of what faculty want students to learn will 
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TABLE 5 

Items for Possible Inclusion in a Teaching Portfolio (Part 3) 



Roles, Responsibilities, and Goals 

• A statement about leaching roles and responsibilities 

• A reflective statement about teaching goals and approaches 

• A list of courses taught, with enrollments 

• A list of clinical teaching assignments, with enrollments 

• Number of graduate advisees 

Annotated Course Materials 

• Syllabi 

• Course descriptions with details of content, objectives, 
methods, and procedures for evaluating students' learning 

• Reading lists, assignments, cases 

• Descriptions of uses of computers or other technology in 
teaching 

• Nonprint materials and how used 

Documentation of Students’ Learning 

• Graded assessments, including pre- and post-tests 

• Students' lab books or other workbooks with written feedback 

• Students' papers, essays, or creative works with written 
feedback 

• Publications authored by students 

• Records documenting students' work at co-op. intern sites, etc. 

• Videotape of student interviews 

• Written feedback to teachers from supervisors of clinical, 
intern, co-op. etc.. *itcs 

Evaluations of Teaching 

• Summarized Mudcnt evaluation* of teaching, including 
response rate and students' written comments and overall 
ratings 

• Results of students' exit interviews 

• Letters from students, preferably unsolicited 



depend on the characteristics of students and their goals. For 
example, faculty might need to alter their approach (but not 
their expectations) if they arc teaching less-wcll-prepared 
students. In some subjects, they might approach teaching 
majors differently from teaching nonmajors. For example, if a 
professor's goal i* to reduce students' anxiety about studying 
philosophy, the professor would probably select different 
readings from those he would select if bis goal were to have 
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• Comments from division head or chair with first-hand 
knowledge of the individual's teaching 

• Letter from colleague who has reviewed the individual’s 
i nst ruct ional materials 

Contributions to Institution or Profession 

• Service on teaching committee's 

• Development of student apprenticeships 

• Assistance to colleagues on teaching 

• Reviews of forthcoming textlxx>ks 

• Scholarly publications in teaching journals 

• Work on curriculum revision or development 

• Evidence of having obtained funds or equipment for teaching 
labs, programs 

• Provision of training in leaching for students or residents 

Activities to Improve Instruction 

• Participation in seminars or professional meetings on leaching 

• Design of new courses and clerkships 

• I'sc* of new methods of teaching, assessing learning, grading 

• Research on teaching, learning, assessment 

• Preparation of a textbook, courseware, etc. 

• Description of instructional improvement projects developed or 
carried out 

Honors or Recognition 

• Teaching awards from department, school 

• Teaching awards from profession 

• Invitations based on leaching reputation to consult, give 
workshops, or write articles on teaming 

• Requests for advice on leaching by committees or other 
organized groups 

Source: Ura.skamp and t )ry 109a. 

students understand how Plato and Aristotle shaped the 
course of Western intellectual history. In other settings, con- 
tent might be much more important. For example, a faculty 
member teaching a foundations course in a master's program 
might need to concentrate on introduc ing students to basic 
concepts, theories and authors. 

To document and reflect on what. whom, and why they 
teach, faculty might include several artifacts generated by 
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their teaching. They might include a syllabus, followed by 
an explanation of how the assignments match whom and 
why they teach. They might include handouts used in class, 
with an explanation of how the handouts assist students in 
achieving goals faculty have for them, or a description of 
how they assess learning styles and how they accommodate 
diverse styles (if they do), or annotated examples of stu- 
dents' graded work. Blit the substance of these sections 
should be their rejections on how the documents reflect 
their philosophy of education. 

The match between teaching strategies and philosophy 

Another section of the portfolio might be usefully devoted to 
a discussion of how the teaching strategies match one's 
philosophical assumptions about learning and the goals of 
the particular course, for example, if teachers believe that 
students learn best by self-discovery, they might give exam- 
ples of how class time or out-ol-class assignments are de- 
signed in lead students to “discover" the intended learning. 
Or if teachers believe that students learn best when working 
together, they might show how they incorporate the princi- 
ples of coopera live learning into their classes. The portfolios 
creator might also wish to discuss how the selected teaching 
strategies match the students' learning strategies. 

Documentation of teaching effectiveness ami reflection 

A portfolio designed to improve teaching needs to include a 
plan for assessing the success of the faculty member's present 
strategies. Faculty should also discuss why they believe these 
techniques accurately assess students* learning. Faculty should 
include a discussion of the demands of the discipline and 
those local circumstances that influence decisions about learn- 
ing outcomes. Assessing effectiveness includes many compo- 
nents. How does one judge w hether students learned w hat 
one expected they would learn? How does the professor eval- 
uate her or his teaching performance? Assessing teaching and 
learning requires pedagogical knowledge and skills that many 
college teachers know little about. In such instances, a portfo- 
lio might contain a plan for developing the requisite knowl- 
edge (see “Formative Kvaluat ion Techniques” on page i9). 
Colleges encouraging teachers to complete portfolios, how- 
ever. may need to commit resources and resourceful teaching 
specialists to assist faculty in assessing teaching and learning. 
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The substance of a teaching portfolio, of course, is the 
documentation of and reflection on the effectiveness of teach- 
ing. The content of this section must be determined by the 
portfolios owner. A portfolio should use multiple sources and 
types of data, but it is imperative to understand that no data 
will substitute for reflection. A portfolio containing only docu- 
mentation without reflection is simply a receptacle for dispos- 
able paper. Moreover, the documentation contained in this 
section of the portfolio should be selective and representative. 
A portfolio need not contain everything produced for or by a 
particular class. Rather, it should contain examples selected 
because they represent an individual’s beliefs about how 
learning takes place, what strategies are effective in reaching 
the selected goals, and how the effectiveness of this course, 
this teacher, and these students are lx.*st assessed. 

Development of a renewal plan 

The portfolio's ultimate value should be the improvement of 
students' learning. Therefore, the last entry' in a portfolio 
could be a plan for professional development — a plan for 
how the professor is going to acquire the knowledge, skills, 
and attitudes that the professor has determined he or she 
limits [o gain after reflecting on what has been learned from 
the process of developing the portfolio. Most portfolios 
should therefore end with a plan to improve the effectiveness 
of teaching. For many faculty, doing so might simply involve 
a few minor adjustments to their method of teaching: for oth- 
ers, it might mean learning more about teaching. Most faculty, 
however, will need assistance. "Faculty members come to us 
strong in content and blissfully ignorant of anything having to 
do with theories of learning and strategies ol teaching rooted 
in pedagogical knowledge of their disciplines. . . . They stand 
on the shoulders of giants: in their knowledge of teaching, 
they stand on the ground** (Fdgerton 1988. 1*2). If faculty arc 
to change their teaching styles, some will need assistance 
from skilled faculty development specialists or master teach- 
ers. And it requires that colleges and universities commit 
resources to the improvement of teaching and learning. 

A portfolio might contain a reflective log (Scldm 1991, p. 
IS). Although finding time to make entries in a reflective log 
can be difficult for the overworked professor, such a log can 
unlock the real value of a portfolio. Recording immediate 
impressions, thoughts on a specific class, disappointments. 
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and thrills, a reflecrve log can certainly provide its owner . 
copious insights into his or her teaching, its real value is in 
the process, not the product. Taking time to record one's 
thoughts occasions reflection on how one's behavior matches 
one's beliefs as well as the appropriateness of those beliefs. 

Exercises to Get Started 

For those having difficulty starting a teaching portfolio, com- 
pleting the following survey can help. When completing the 
items, it will help if you not only describe what you do but 
also explain why you make the choices you do. 

1. What is the purpose of your portfolio? Is it for the 
improvement of teaching, tenure, promotion, or some- 
thing else? 

2. What and whom do you teach? In answering this ques- 
tion, tell what you teach, whom you teach (freshmen, 
majors, returning adults, for example), whether or not 
the course is required, how many students are in a typi- 
cal section, now you would describe the typical student, 
why they take your course, and so on. 

Examine the answer to the previous question and de- 
scribe your purpose in teaching what you select to 
teach. Is it to prepare students for future course work, 
employment, or what? Is it remedial? Is it to open stu- 
dents to new experiences and ideas? 

4. What teaching techniques or styles do you employ? Why? 

5. How do you assess whether students arc learning? Why 
do you assess the way you do? What kinds of assign- 
ments. exams, or projects do you use. and why did you 
select them? 

A key component of the teaching portfolio is the statement 
of your philosophy of teaching. Some prefer to write a ‘fram- 
ing statement'’ of their educational values whose purpose is 
to put beliefs about the teaching/learning enterprise in per- 
spective and compare what you believe with what you do. 

Some teachers find it difficult to write down their educa- 
tional philosophy. One means of discovering meaning in any 
aspect of our lives is through metaphor, and many individu- 
als who find it difficult to explain their motives or actions can 
line! a metaphor that sums up what they think. These “guid- 
ing metaphors" (Grasha 1990) are intended to explain some 



J1 



44 




major part of our belief system or behavior. Teachers who 
are trying to state their teaching philosophies can construct a 
guiding metaphor and thus find the meaning embedded in it. 

The following steps are meant to help you get started 
(see Grasha 1990). 

L. Jot down some words and short phrases that describe 
what you teach, why you teach, how you teach, how 
you assess students, and so on. The words need not 
seem connected to one another but should be descrip- 
tive and concrete (for example, tough, abstract, tradi- 
tional, exciting, unexplored). If you are stuck, try 
looking at the nouns, especially the proper nouns, and 
jotting down three or four adjectives that come to mind. 

2. Scan the words and write dow n images they suggest. For 
example, for complex," one might say "a tangled spi- 
der's web." or for “playful,” one might say “like a kitten 
with a ball of string.” Some individuals might find it eas- 
ier to draw, a picture or pictures for these first two steps. 

3. Look over the words and images you have jotted down 
for themes, lake the themes you discover and put them 
into a “guiding metaphor.” Try to incorporate as many of 
the themes as you can into one metaphor that you be- 
lieve sums up your leaching beliefs and style. 

4. Take the metaphor you have devised and elicit what it 
says about what you believe about teaching. 

To illustrate, the words you might have jotted dow n in 
the first step could include “discover." “explore." “new." and 
“uncharted." 'file images might be explorer, pioneer, astro- 
naut. Lewis and Clark, virgin forest, and wild, untamed 
rivers. 'Flic? guiding metaphor might then become an ex- 
plorer leading a party on a journey to where they have 
never been, guiding them safely through thick underbrush 
and overgrown vegetation, and across raging rivers. 

Summary 

What sets teaching portfolios apart is that they provide 
instructors w ith a means to tailor the assessment of teaching 
and learning to their individual situations. Consequently, the 
actual content of teaching portfolios will vary from professor 
to professor. Decisions about what to include depend on the 
intended use of the portfolio. Therefore, it is important for 
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When port- 
folios are to 
be used to 
improve 
teaching and 
learning, the 
issue of the 
assessment’s 
reliability or 
validity is not 
paramount. 



faculty to know how the portfolio will he used before they 
start to create one. Teaching portfolios to he used for tenure 
or promotion should he compiled according to certain stan- 
dards that specify what the portfolio must contain (student 
evaluations of faculty, for example), the maximum length, 
the order of presentation of materials, and so on. Because 
the standards are meant to ensure that all candidates receive 
equal consideration, the specific standards are less important 
than their existence. 

Portfolios are collections of documents and artifacts gen- 
erated in the process of preparing and teaching a course and 
reflections on how these selected items reveal the quality of 
ones teaching, leaching portfolios provide more meaningful 
data when they are organized in some systematic manner. 
Moreover, teaching portfolios should he living documents 
that provide for future changes in one s teaching. 

The only essential component of a teaching portfolio is a 
statement of one's beliefs about teaching, for what one 
believes about teaching will influence how one teaches. A 
teacher who believes that his or her students cannot learn 
will intentionally or unintentionally convey that belief to 
students. And students will probably meet the teacher's 
expectations. On the other hand, a teacher who has high 
expectations and conveys the belief that students can meet 
them will have “better" students. By devoting the same 
scholarly methodology and energy to teaching that many 
professors devote to research, professors can learn how to 
improve the quality of their instruction. 
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EVALUATING PORTFOLIOS 



If leaching portfolios become part of the documentation 
used to make summative personnel judgments (tenure, pro- 
motion. merit pay. for example), then colleges and universi- 
ties should decide how they are to be evaluated. In fairness 
to faculty, the standards should be developed and clearly 
articulated before anyone begins to develop a leaching port- 
folio. Two caveats apply to institutions developing criteria to 
evaluate portfolios. First, the standards will be more effective 
if they are developed collaborativelv by colleagues within a 
department and explicitly linked to that department's and 
the college's definition of effective teaching. Second, the 
criteria should fit the institution's mission. In a community 
college, for example, if a department’s mission is preparing 
students for transfer, then the criteria should evaluate how 
well a particular instructor does so. In a graduate school 
MBA program, if the mission is preparing future business 
leaders, then the criteria should evaluate how well a particu- 
lar instructor does so. 

Evaluating Qualitative Evidence 

In any evaluation system, the type of evidence and the form 
of assessment differ, depending on purpose. Summative eval- 
uation must, by its very nature, be judgmental; that is. sum- 
mative evaluation must assign value or worth to the prod- 
uct. On the other hand, formative evaluation should not 
assign value but should provide specific and detailed analysis 
of how effectively techniques and strategies were employed 
to accomplish the desired objectives. Therefore, it is neces- 
sary to consider how a teaching portfolio will be used before 
determining how it is to be evaluated. 

When portfolios are to be used to improve teaching and 
learning, the issue of the assessment s reliability or validity is 
not paramount. The improvement of teaching and learning 
is paramount, and the very process of developing a leaching 
portfolio accentuates these issues as much as, if not more 
than, the assessment of the portfolio. If the leaching portfo- 
lio is to he used for summative purposes (such as personnel 
evaluation), however, it is important that assessment proce- 
dures are reliable and valid. Devising reliable and valid tech- 
niques for assessment can be somewhat more difficult, 
because portfolios contain quantitative and qualitative data, 
and the evaluation of qualitative data can be subjective. 
“Portfolios do not lend themselves to quick, summary judg- 
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merits about professional accomplishments (such as those 
achieved by simply counting publications on curriculum 
vitae). That is. in fact, the primary virtue of portfolios — they 
reflect the complexity and interrelatedness of all teaching, 
research, and service activities” (Fnoh, Gray, and Lambert 
1993, p. 109). 

Teaching portfolios provide promotion and tenure com- 
mittees with information about a faculty member's teaching 
not readily available through other sources (Seagren, Cres- 
well, and Wheeler 1993). Blit the evaluation of qualitative 
data also entails certain disadvantages. 

Most promotion duel tenure committee s do not bare 
experience in era! noting portfolios: the portfolio re - 
(jit ires a greater commitment of time to examine the 
complete record: and administrator and promotion 
committees could bare more difficulty making c/uafita- 
tire judgments, as teaching history is presented in con- 
text rather than in compel) iso //(Seagren, Creswell, and 
Wheeler 1993. p. *9). 

Although similar concerns are often expressed when cam- 
puses discuss teaching portfolios, such concerns are based on 
the mistaken notion that promotion and tenure committees 
base their decisions almost entirely on objective, quantitative 
evidence. The inclusion of qualitative material in decisions 
about personnel, however, is not new io higher education. 
Nearly all tenure and promotion committees at any college or 
university are asked to evaluate the quality of a candidate’s 
teaching, research, and publications. Although administrators 
are shy to admit it in these litigious times, they are qualitative 
judgments. Moreover, these judgments are often made with- 
out the benefit of explicitly agreed-upon public criteria and 
hence rely heavily on the subjective lx*liefs of individual 
committee members or administrators. The introduction of 
teaching portfolios does not increase the subject iveness in- 
herent in evaluation procedures: rather, by adding documen- 
tation about the quality of teaching, teaching portfolios add 
to the completeness of the judgment. 

If the purpose of the portfolio is the evaluation of teaching, 
it will be necessary on many campuses to first dispel the myth 
that good or effective teaching cannot be defined precisely 
enough to be evaluated. Faculty often react rather typically. 
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Most faculty memlxns did not feel that they could make 
qualitative judgments on the dimensions of teaching . . .. 
and even those that felt they could did not feel cotnfoti- 
ahle doing so. They felt that differences uvre a matter of 
"style" or fyersonal preference. Furthermore . some of the 
most important objectives of instruction, such as develofy- 
iug thinking skills, fostering multiple rieivpoints in stu- 
dents. challenging their stereotypes, or enriching their 
appreciation of others, are difficult to readily change 
and we do not hate adequate measures to show those 
changes. Some of these objectives are best justified as 
fx’ing of value in and oflbemselves. and difficulty in 
relating l them! to demonstrable changes in student learn- 
ing may subvert attention to them in instruction. At this 
point in the development of portfolio review, for account- 
ability put poses it is probably best left up to individuals 
who have to make those judgments, such as chairs and 
those faculty memlxns saving on promotion at id tenure 
or awards committees ( Robinst m 1 993. pp. 1 6-1 7). 

Although this study was conducted at a single university, 
such beliefs are rather pervasive throughout higher educa- 
tion (Massey, Wilgcr, and Colheck 1994). Nonetheless, excel- 
lent departments that sincerely care about the quality of 
teaching will find ways to overcome such complaints. Many 
of the efforts to define excellence in teaching are discussed 
in “Shaping an Institutional Definition of Good leaching* 
(see page 63). The most effective reply to those who claim 
teaching cannot be evaluated is to develop a system and 
criteria that work. 

Developing Explicit Evaluation Criteria 

Developing summative evaluation procedures for teaching 
portfolios starts by determining what is to he assessed and 
how it will he assessed. The first step is determining what 
should he included in the portfolio (see “What Goes into a 
Teaching Portfolio?" on page 19). The second step is to define 
explicitly the criteria that will lx* used to evaluate the portfo- 
lio. Faculty, particularly departmental faculty, should provide 
input for both steps. The content of the portfolio and the eval- 
uative criteria should have some relationship to the demands 
of the discipline and the institutional mission. When teaching 
portfolios become part of the documentation used to make 
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summative judgments, it is best to require what must be mini- 
mally included (Seldin 19931 5). Colleges and universities might 
also wish to set limits on what can lx; included, the length of 
sections, and so on. Requiring common content and setting 
limits, while potentially somewhat stifling of creativity, provide 
a common framework for making comparisons among faculty. 

When developing holistic criteria for assessing what a 
teaching portfolio reveals about the quality of teaching, eval- 
uation committees should ask certain key questions. 

• Is real evidence of accomplishment presented, not just a 
reflective statement? 

• Is the reflective statement of why and what is done in the 
classroom consistent with the syllabi and student or peer 
evaluations of performance? 

• Is evidence of students learning presented, not just mate- 
rial from others and materials from one s self? 

• Is an effort to improve performance reflected in the eval- 
uation reports? (Seldin 1992, p. M). 

These questions provide a means to arrive at a general 
assessment of the portfolio. but evaluators will also need to 
develop criteria for assessing the specific documents pre- 
sented in the portfolio. The following five questions could 
be used for that task. 

1. Wlvat is i he quality of the materials used in teaching? 

2. What kinds of intellectual tasks did the teacher set for 
the students (or did the teacher succeed in getting stu- 
dents to set standards for themselves), and how did the 
students perform? 

3. How knowledgeable is this faculty member in the sub- 
jects taught? 

a. Has this faculty member assumed responsibilities related 
to the departments or university's teaching mission? 

S. To what extent is this faculty member striving for excel- 
lence in teaching? (ITench-Lazovik 1981. pp. 76-78). 

both set of questions provide starting points for campuses 
to develop more specific criteria for assessment. Although 
the criteria work best when tailored lo an institution's partic- 
ular mission, two points must considered, first, active and 
extensive involvement by faculty in the development of the 
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criteria will he more likely to produce criteria that consider 
both the demands of the discipline and the institutional mis- 
sion. Second, those developing the criteria might want to 
avoid the temptation to overemphasize those aspects of 
teaching that are easy to quantify. On many campuses, fac- 
ulty are becoming disheartened over the grow ing tendency 
to rely almost exclusively on numerical evidence (such as 
student evaluations, numbers of publications, amounts of 
grant monies) for stimulative types of evaluations. 

After explicit criteria have I'jeen developed, the next step 
is to define expected levels of achievement. Evaluation 
instruments that spell out in as much detail as possible what 
each achievement level means are preferable. To say that “-T 
equals excellent performance and T’ equals poor perfor- 
mance for some criterion not only tells the reader very little; 
it also does not help the professor know how or why it was 
given. Professors deserve to know, in advance, what it takes 
to achieve a specific level of performance. If they fail to 
achieve an adequate or superior rating, they deserve to 
know specifically what they did not do. For example, if one 
of the evaluation criteria concerns the quality of the course 
syllabus, a rating scale might look like this: 

1 . The instructor provides no syllabus. 

2. flic instructor provides a syllabus from a previous term 
that contains inaccurate or outdated material, dates, or 
references. 

.V The instructor provides a syllabus that contains only the 
information found in the college catalog and or course 
schedule. 

t. The instructor provides a syllabus that provides a com- 
plete course description, course objectives, class meet- 
ing times, office hours, basic grading criteria, a tentative 
schedule of assignments, due dates, and other basic 
course information. 

5. I he instructor provides all the above plus detailed ex- 
planations of such things as grading criteria, how to 
study for exams, the objectives of each assignment and 
class, an explanation of how this course meets the mis- 
sion of the department and. or the college, and so on. 

The exact form each evaluation criterion takes depends 
heavily on the college's or university's culture and what it 
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values. Therefore, involving faculty in the process of devel- 
oping the criteria is critical — not only to the acceptance of 
the criteria, but also to their validity. 

Some do not share this preference for explicit criteria, 
warning of a “crisis in spirit.'* which can be blamed on the 
tendency of colleges and universities to move more and 
more toward explicitly defined evaluation criteria (Whitman 
and Weiss 1982). While on the one hand using explicit crite- 
ria is "fair play," its use might bring out some undesirable 
faculty behaviors. 

Explicit criteria encourage faculty to do things for the 
sake of evaluation. A potential abuse is that faculty will 
meet criteria . hut not with the quality or the desired spirit 
(faction. For example, suppose that one criterion of 
effective teaching is " the instructor provides students with 
an up-to-date bibliography. "A teacher who is intrinsi- 
cally motivated to conduct the cot uses may naturally be 
familiar with new contributions to the literature and trill 
update the bibliography as a matter of course. In this 
case, we can imagined teacher who critically reads the 
literature and thoughtfully adds to and subtracts from 
the bibliography with 1st intents I needs in mind. . . . With 
the advent of explicit criteria . one could notv imagine a 
faculty member adding new citations to the bibliography 
without having read the new material. . . . hi fact, one 
could etxnt imagine an extrinsicafly motivated teacher 
preparing ait annotated bibliography based on informa- 
tion provided on lx tok jacket conns and journal article 
abstracts (W hitman and \U iss 1982. p. 34). 

Although the danger exists that a charlatan might attempt 
to manipulate the system for devious purposes, it is unlikely 
that a professor could sustain such fnkery throughout the 
entire teaching portfolio. While it might he possible to pass 
off some inauthentic materials, such as a bibliography based 
on information provided on hook jacket covers and journal 
article abstracts, most materials would lx* much more diffi- 
cult to counterfeit. An instructor who went to all the trouble 
to develop numerous counterfeit instructional materials to 
include in a teaching portfolio would have a very difficult 
time sustaining the effort over an entire course. Moreover, 
the instructor's colleagues are not fools and would surely 
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recognize the shallowness of such an effort. When a course 
has no substance, it is highly unlikely that an instructor 
could create the appearance of substance. 

Who Should Evaluate a Portfolio? 

Another critical question (when teaching portfolios are eval- 
uated for summative purposes) deals with who should eval- 
uate the portfolio. Several possibilities exist, but when the 
stakes arc high (a decision about tenure, for example), a 
“campus might well want to cultivate a small group of 
highly trained portfolio readers, individuals who specialize 
in particular types of entries or categories rather than being 
responsible for rating entire portfolios" (Edgerton, Hutch- 
ings, and Quinlan 1991. p. 52). While a highly trained group 
of raters would appear to be desirable, parceling out por- 
tions of the portfolio to be separately evaluated could result 
in a disconnected evaluation report. Effective leaching is a 
complex act that involves not only several variables, but also 
the interplay among those variables. Attempting to evaluate 
teaching in a segmented fashion could obscure those inter- 
actions. In fact, “holistic evaluation can be more helpful than 
a fine-grained, analytic scoring system — a system that was 
found to turn the evaluation of portfolios into a mechanical 
" task" (p. 52). 

The selection of those who are to evaluate the portfolio is 
integral to the reliability of the results. The selection of eval- 
uators involves some pitfalls; 

. . . too dose friendship between l the I candidate and the 
judges, too Jew judges, judges inching sufficient knowl- 
edge in (he candidate's field, judges in contention with 
the candidate, lack of anonymity of judges, inch of in- 
dependence in the judgment process, permitting some 
j)eers to act as advocates or adversaries, and fat in re of 
peer review committees to provide reasons for negative 
decisi<nisiViviK'\\-\/A7.<)\\k 1981. p. 82). 

Yet another consideration concerns the training of evalua- 
tors. Most faculty members have little or no formal educa- 
tion in pedagogy or assessment techniques, and most tend 
to develop their teaching styles by imitation and trial and 
error. While they might work for developing an individual s 
teaching style, these techniques seldom provide insights into 
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other effective teaching styles. Because evaluators of portfo- 
lios should be familiar \vij.i a variety of teaching styles and 
approaches for assessing the effectiveness of teaching, some 
training in the evaluation of teaching and teaching-related 
documents is necessary'. Moreover, in summative evalua- 
tions, consistency in judgments is critical. Consistency re- 
quires that a Single evaluator, judging different portfolios, 
employs the same criteria and produces similar results (the 
basis for the reliability of findings) across all portfolios and 
that different evaluators come to similar conclusions about 
the same portfolio (the basis for the reliability of evaluators 
or “interrater reliability”). Training raters can increase the 
reliability of judgments (Centra 1993). and it can dramatically 
increase interrater reliability (Hoot 1987). 

Trustworthy Evidence 

When the results of the assessment of teaching portfolios are 
used in personnel decisions, care must be taken to ensure 
they are used fairly. “The ev idence supplied for the assess- 
ment of faculty activities and contributions must meet the 
demands of trustworthiness — dependability, applicability, 
defensibility, and relevance" (Braskamp and Orv 1994. p. 

90). “Four conditions or requirements for trustworthiness . . . 
are particularly important in faculty assessment: reliability, 
validity, fairness, landl social consequences" (p. 91). 

Reliability 

“Reliability is the degree to which a test consistently mea- 
sures whatever it measures. The more reliable a test is, the 
more confidence we can have that the scores obtained from 
the administration of the test are essentially the same scores 
that would be obtained if the test were readministered'' (Gay 
I98“\ p. 135). Reliability is a necessary, although not suffi- 
cient, condition for validity. Two aspects of reliability are to 
be considered in the assessment of portfolios: ‘the consis- 
tency and dependability of the information" (Braskamp and 
Ory 1994, p. 91) and the consistency of scores from rater to 
niter (interrater reliability). Both present special considera- 
tions to designers of portfolio projects. 

Those interested in ensuring that teaching portfolios pro- 
vide consistent and dependable information about a pro- 
fessors teaching can take several steps. Campus leaders 
interested in improving reliability should pay careful atten- 
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tion to “what documentation is prov ided to the reviewers, 
what principles are followed in selecting peer judges, and 
what procedures govern the conduct of the review process" 
(French-Lazovik 1981. p. 75). With regard to the dcx'umenta- 
tion supplied the reviewers, campuses should "require port- 
folios used for tenure and promotion decisions, or teaching 
excellence awards, to include certain mandated items” 

CSeldin 1993b. p. 72). 

Questions of interrater reliability inevitably arise during the 
evaluation of qualitative data found in teaching portfolios. 

The results of one of the few studies of interrater reliability 
regarding teaching portfolios indicate that when campuses 
carefully select and train the portfolio evaluators, it is possi- 
ble to achieve interrater reliability (Centra 1992). That study 
involved 97 community college faculty members and com- 
pared the portfolio ratings of two peers and a dean for relia- 
bility. The results from each rater's portfolio evaluation were 
also compared to results of students' evaluations. The results 
indicate that thoughtful selection of the raters is a necessary 
condition for interrater reliability. 

In the study, each portfolio was assessed by the appropri- 
ate dean, a faculty member selected by the appropriate 
clean, and a faculty member selected by the faculty member 
being evaluated. Centra found differences among the raters 
and that, in general, the ratings given by peers selected by 
the faculty being evaluated did not correlate with those 
given by the dean or the faculty member selected by the 
dean. Moreover, the ratings given by the peers selected by 
the faculty members being evaluated did not correlate with 
the student instructional report developed and marketed by 
Educational Testing Service. Hut the evaluations of the dean 
and of the peer selected by the dean did correlate signifi- 
cantly with each other (Centra 1993, p. 1 1 ). And the ratings 
by the dean and by the faculty member selected by the dean 
correlated significantly with student evaluations. 

These findings suggest that if the ev aluators are not care- 
fully selec ted, evaluation of a portfolio by peers may pro- 
duce varied results, making it difficult to make reliable 
comparisons among individuals. 'The selection of the peers 
by those being evaluated introduces the crror(s) resulting in 
the lack of interrater reliability (Centra 1993). A more ran- 
dom process for selec ting raters might inc rease interrater 
reliability (French-Lazovik 1981; sec also Centra 1993). 
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Moreover, the absence of interrater reliability in Centra's 
study was in part the result of the fact that "the peers and 
deans were largely expected to use their own criteria and 
standards for judging the portfolios" (p. 14). Training raters 
of portfolios would likely "make their judgments more valid 
and reliable" (p. 16), and when evaluators are trained, “a 
teaching portfolio can be very useful in summative deci- 
sions" (p. 16). 

When raters were provided some “basic training," “the 
composite reliabilities of the six raters [werel over 0.900" 
(Rcx)t 1987. p. 79). Moreover, because of the high level of 
the composite reliabilities, the ratings of three properly 
trained raters could provide sufficiently reliable judgments 
for summative evaluation purposes (Root 1987). 

Validity 

The most simplistic definition of validity is that it is the 
degree to which a test measures what it is supposed to 
measure, A common misconception is that a test is. or 
is not. valid. A test is not valid per se: it is valid fora 
particular pi npose and/or a particular group. . . . 7 he 
(fttestion is not " valid or invalid" hut rather "valid for 
wh(itor forlu'h()inl"lCr<\\ 1987. p. 128). 

Another way of saying it is that "validity does not refer to the 
instrument or method of collecting data: rather, it refers to the 
inferences and generalizations based on the evidence" (Bras- 
katnp and Ory 1994. p. 92). Several critical questions regard- 
ing the validity of the assessment must first be answered. The 
primary question is “What are we measuring?" In other 
words, what are the indicators of good or effective teaching? 
The next question is "1 low do local circumstances alter nr 
modify the definition of good or effective teaching?" We 
know that local circumstances can call for different purposes 
and outcomes. Another question to address is "What kind of 
documentation would suffice to indicate good or effective 
teaching?" Still another key question is "Who is qualified to 
judge?” “Improved validity depends heavily on what ques- 
tions are addressed by the review, what documentation is 
provided to the reviewers, what principles are followed in 
selecting peer judges, and what procedures govern the con- 
duct of the review process" ( french- 1. a zovik 1981. p. ”5). 
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Fairness 

“Fairness" is an imprecise concept that most experts on as- 
sessment tend to avoid. Nonetheless, the integrity of any eval- 
uation prex'ess depends totally on the fairness of the process 
and players. Moreover, because reliability and validity are 
necessary' conditions for fairness, some overlap occurs among 
these concepts. Fairness deals primarily with the adequacy of 
the evidence; that is. does it reflect the "complexity of the 
achievements and accomplishments being assessed? (Bras- 
kamp and Ory 1994. p. 92). The adequacy of the evidence 
can be enhanced by “a strategy called triangulation — gather- 
ing, assembling, and combining evidence from a number of 
perspectives to form an integrated picture ” (pp. 82-83). 
Fairness also involves the adequacy of the judges to make the 
judgment. That is, fairness requires that the judges have “thor- 
ough knowledge of the discipline. . . . what is taught, its 
accuracy, currency, sophistication, depth, and level of learn- 
ing it fosters” ( French-Lazovik 1981. pp. 74-73). 

Social consequences 

Social consequences "are the intended and unintended con- 
sequences of assessment for the activity and the organization" 
(Bruskamp and Ory- 1994. p. 92). Any evaluation process 
should influence the behavior of those being evaluated. 
Colleges and universities can design, purposefully or. haphaz- 
ardly. an assessment process that will impact teaching. When 
professors believe that their performance in the classroom 
will bring institutional recognition, they will make it a prior- 
ity. When they believe research and publications will bring 
institutional recognition, they will make them a priority. 
Colleges and universities communicate to professors what 
they should make a priority by the emphasis they place on 
the activity during the process of evaluation. 

The evaluation of teaching portfolios for formativ e pur- 
poses requires a less rigorous methodology than evaluation 
for summative purposes. Nevertheless, it is still necessary to 
consider how such an assessment can be used to improve 
teaching. Kven when the aim is to improve teaching, “pur- 
poses should drive practice” (Iklgcrton. Hutchings, and 
Quinlan 1991. p. 32). 

(/.for instance, the ftoinl is to encourage conrersation 

about teaching across de/Hirlinents that arc usually 
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isolated from one another, it non Id make sense to have 
an interdisciplinary faculty group-read portfolios. ... If 
. . . the point is to encourage greater attention to the 
con tent -specific nature of teaching .... each depart- 
ment might he responsible for reviewing its nil'll portfo- 
lios. . . . If the primaiy thrust of the portfolios is individ- 
ual improvement, the most powerful context for evalua- 
tion might he small groups or pairs of faculty (Hdgerton. 
Hutchings, and Quinlan 1991. p. ^2). 

Summary 

The evaluation of portfolios requires careful consideration of 
the propose for compiling them. If portfolios are to he used 
for summative purposes, special care must he taken to 
involve faculty in the development of explicit evaluation 
criteria. Moreover, institutions of higher learning must ensure 
that the evaluation process and procedures are reliable, 
valid, and fair. No one method is best. Rather, the institu- 
tional context, the purpose, and the discipline must all be 
taken into consideration. "There are no doubt man r useful 
routes to evaluating portfolios" (Kdgerton. Hutchings, and 
Quinlan 1991. p. S2>. The most tragic outcome that could 
befall the movement toward using teaching portfolios in 
higher education would be to standardize the process and 
the evaluation. The appeal of the portfolio, in any profes- 
sion. comes from its ability to allow the professional to show 
his or her individuality and creativity in achieving the mis- 
sion of the profession. 




FORMATIVE EVALUATION TECHNIQUES 




Students, oneself, colleagues, and administrators are the pri- 
mary sources of information that might be used to improve 
one's teaching. Many institutions have formal processes for 
gathering opinions and judgments from some or all of these 
sources — most often in the form of administrative and/or 
student evaluations. Usually these processes and the data 
gathered become the basis for making personnel decisions 
about the individual faculty member. Only rarely do these 
processes include any formal plan for using tiie data gath- 
ered to improve an individual's teaching. Often this process 
of gathering information is labeled “suminative evaluation." 

In addition to sumnuitive evaluation, assessment for the 
improvement of teaching and student learning often includes 
what many call “formative evaluation." Formative evaluation 
is intended to provide professors with useful, timely feed- 
back that can lie used to improve, their teaching and ulti- 
mately students' learning. Some commentators on faculty 
development, hoping to avoid the negative connotations that 
have sprung up around the concepts of “assessment" and 
“faculty evaluation," use “informative feedback" rather than 
formative evaluation (Centra 1993). Despite some disagree- 
ment about terms, “among all instructional development 
efforts the most promising way of fundamentally changing 
postsecondary teaching is to provide faculty with individual- 
ized formative feedback” (brinko 199,3. p. 57t). 

Whatever it is labeled, if the improvement of teaching and 
learning is t he ultimate goal of a portfolio project, most fac- 
ulty will need to learn how to assess the effectiveness of their 
teaching and its effect on students' learning. Although many 
faculty are quite capable of knowing when students are not 
getting the material, many do not know how to go about dis- 
covering why or what students are not learning. Incompe - 
tence or indifference is not usually the reason for this sad 
stale ol affairs. More often, the root cause is that faculty well 
educated in a discipline lack the knowledge of how to assess 
their teaching, their students' learning, or their courses. 
Therefore, the complete portfolio project will plan activities 
intended to help faculty learn how to assess their teaching, 
their students' learning, and the currency of their courses. 

When we w ant to know how well we are teaching, we can 
turn to four primary sources — students, ourselves, colleagues, 
and administrators. For this discussion, colleagues and admin- 
istrators are treated as one category. In most situations where 
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the goal is the improvement of instruction rather than summa- 
tive evaluation, the administrative assistance comes from the 
department or division chair. In such cases, it is probably 
more appropriate to think of the chair as a colleague rather 
than a supervisor or administrator. The chair should collabo- 
rate and facilitate rather than supervise or judge. 

Students 

Perhaps the best source of information about the effectiveness 
of one’s teaching is students. Students are the only individuals 
who regularly observe us in action, and it is for their benefit 
we teach. This symbiotic relationship between professors and 
students means that it is not only in our best interests to re- 
spect what they can tell us about our teaching, but also in 
their best interests to assist us to improve our teaching. 

Techniques for formative cvu’untion by students range 
from very formal procedures like Teaching Analysis by Stu- 
dents (TABS) (Clinic to Improve 19 7 -H to more informal class- 
room research techniques (Angelo and Cross 1993). At the 
formal end of the spectrum, such techniques look very similar 
to the student evaluation instruments now widely used in l.S. 
institutions of higher education (see Seldin 1993a). These 
evaluations, however, tend to be primarily for summativc pur- 
poses and frequently cany suddcn-dcath implications’’ (Sel- 
din 1993a. p. 6). because of the serious implications flowing 
from summativc student evaluations, some have suggested 
that summativc and formative, evaluation of necessity must be 
separated, fearing that information that might point to areas 
needing improvement could become harmful when used in 
making decisions about personnel. 

The issue of whether summative and formative evaluation 
data can be gathered with the same instrument and or from 
the same evaluators often provokes strong conflicting opin- 
ions. The modest amount of research available on this issue, 
however, appears to support those who believe the two 
functions are compatible (blackburn and Pitney 1988. p. 17). 
’Much of the argument on the other side (namely, advocat- 
ing the split) is theory based. The theoretical argument sup- 
porting the split role has to do with role incongruity. How- 
can a supervisor he a helper and a judge at the same time?” 
(p. IT). It is apparent that the two functions call for different 
types of questions. Summative evaluations call for a.- 
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. . . form focusing on global, widely applicable charac- 
teristics. . . . But a global rating form of this type is of 
limited value for self-improvement purposes . because it 
says nothing about idiosyncratic factors in teaching, 
fails to sfwcify the reasons for low ratings, and provides 
no specific suggestions for improvements. Murray 
1987, p. 86). 

Several points are to be considered w hen faculty select or 
design formal formative evaluation procedures or instru- 
ments. The instrument should be distributed after students 
have had sufficient time to observe the teacher s style but at 
or before midterm to allow for "midcourse” corrections. 
Several studies (see, e.g.. McKeachie, Lin. Daugherty. Mof- 
fett, Neigler, Nork. Walz, and Baldwin 1980: Overall and 
Marsh 1979; Stevens and Aleamoni 1985) have found that 
providing faculty with feedback from students at midterm 
can improve teaching, especially w hen the feedback is com- 
bined with advice from a faculty development specialist 
(Brinko 1993). If faculty conduct evaluations early in the 
term, the students who provide the information will gain 
some of the benefit from any changes the faculty make. 

Unlike summative evaluations, formative evaluation instru- 
ments are meant to provide specific, useful feedback to 
improve instruction: therefore, formative instruments should 
have 20 to 30 items (compared to only a few for summative 
evaluation instruments) (Seldin 1989). Some recommend the 
use of items that query students about specific teaching 
behaviors (II. Murray 1987: Seldin 1989). while others find 
open-ended questions more useful (Fuhrmann and Grasha 
1983). No researcher seems to have tackled the question of 
which is more useful for the improvement of teaching, al- 
though in one study faculty preferred items that probe spe- 
cific teaching behaviors (li. Murray 1987, p. 89). The choice 
between items that query students about specific teaching 
behaviors or open-ended items would seem to be up to the 
preference of the instructor. Most likely, both types of items 
would provide useful information to instructors attempting to 
improve their effectiveness as teachers. But regardless of the 
form the items take, all items should relate to behaviors that 
students are in a position to judge reliably. Table 6 provides 
some examples of published instruments or procedures avail- 
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able to faculty for gathering information from students to 
assess and improve teaching and student learning. 

In addition to these more structured approaches, a variety 
of other creative approaches can be used to gather evalua- 
tive data from students. Among them are numerous varia- 
tions of Small-Group Instructional Diagnosis (SGID), said to 
have been originally developed at the University of Wash- 
ington ( Bra ska mp and Qry 1994; Centra 1993). Although the 
process varies a little from user to user, what is probably 
the "purest” form of SGID involves the instructor's leaving 
the class in the charge of an outside facilitator (Coffman 
1991). The facilitator asks the students to work in small 
groups to answer three questions; ( I) What do you like 
about this course? (2) What do you think needs improve- 
ment? (3) What specific suggestions do you have for chang- 
ing this course? (p. 80). Hath group must come to a con- 
sensus on any point before it can be reported to the whole 

TABLE 6 

Published Instruments or Procedures for Faculty Evaluatloi 

• H.G. Murray (1987) developed a (>0-item diagnostic instru- 
ment.* which he did not copyright and encourages others to 
use. Murray's instrument is valuable because it is well grounded 
in research — a rarity for formative evaluation instruments. 

Moreover, this instrument prolx*s specific teaching behaviors 
— behaviors that, for the most pan. the teacher can quickly 
and easily modify. Although this instrument was designed It) 
gather data from students, it can also be used by colleagues 

for peer observation. 

• Teaching Analysis by Students <TAHS> was first developed by 
researchers at the University of Massachusetts at Amherst 
(Clinic to Improve I9“M) and has been modified and used at 
many universities and colleges since then. Various forms of the 
instrument can he found in several different publications 
(llilscn and Rutherford 1991; Hoover I9K(>), TAMS probes more 
general teaching behaviors than 11. (i. Murray's instrument, and 
users might therefore find it more difficult to modify behavior 
without the assistance of a faculty development specialist. 

• Hor those interested in open-ended questions. Kuhnnann and 
Graslia ( 19H.M provide several forms aimed at probing different 
aspects of teaching. They offer an open-ended sentence form 

( p. I9“) aimed at getting specific feedback on any aspect of the 



K ? BEST COPY AVAILABLE 




class. After the groups have developed a consensus, the 
facilitator asks each group to report its findings to the entire 
class. The facilitator records the items on the chalkboard. 

If a majority of the class disagrees with an item, "it is either 
eliminated or reworded to satisfy the majority of the class 
members (p. 81). The facilitator provides the instinct or with 
a written summary and encourages the instructor to discuss 
the findings with the class. The instructor should tell the 
class what changes he or she will make and what he or she 
cannot change and w hy. SG1I) has several variations (see 
J.R Murray 1991 for a description of a similar technique that 
an instructor can use without the assistance of a facilitator). 
Whatever variation is used, faculty could include in a portfo- 
lio a summary of a group midterm evaluation, a description 
of changes made, an evaluation of the effectiveness of the 
changes, and a reflection on what was learned from the 
process. 



course. They also offer a 59- item student rating form <pp. 

201-2) with an interesting twist; they suggest that you ask 
students to take the three items for which they gave you the 
lowest score and “list one or two specific behav iors or course 
incidents that made them give you the rating they did” (p. 200). 

• Miller ( I9S~) offers a short ( 1-t-itcm) form for students' 
appraisal of classroom teaching ipp. Kvt-05) for faculty 
interested in getting a quick overview of how their students 
rate their teaching. Suc h a form is adv antageous because it 
docs. not require much class time and can he administered 
more than once during an academic term. 

• effective teaching requires effective planning; therefore, pro- 
fessors must evaluate not only their teaching, hut also their 
planning, hrinko ( IW) offers an lK-item. multiple-choice sur- 
vey form aimed at assisting professors to design their courses. 
Once the course has been designed and is being taught, pro- 
lessors might wish to evaluate how well they are accomplishing 
their goals. I'uhrmann and Grasha ( 198.4) offer a goal assess- 
ment form (pp. 198-99) aimed al gelling students’ opinions on 
how well llu* professor is accomplishing goals, for the- course. 

'This instrument and seu-r.il oiIums can he found in WVimcr, h.nieu. and 

Kerns pass. 






Successful Faculty l k’t clef uncut ami Fmtutitum 



63 




Some other creative formats for eliciting students' opin- 
ions on how to improve instruction involve techniques that 
now fall under the rubric of Total Quality Management 
(TQM) or Continuous Quality Improvement (CQI). Although 
several variations of TQM in the classroom are available, the 
most common involve quality circles (Braskamp and Or)’ 
1994: Kogut 1984: Weimer 1990). In business, quality control 
circles are ' committees’* empowered to participate in man- 
agement decisions for the purpose of controlling quality and 
improving the product. For quality circles to function in a 
college setting, the professor must sell the concept of a qual- 
ity circle to the group, instruct the circle in its functions, 
maintain enthusiasm, and "coach" the group after it begins 
to operate (Kogut 1984. p. 124). The advantages of quality 
circles are that students have a vehicle through which they 
can give "excellent continuous feedback." permitting lec- 
tures to be fine-tuned almost daily. Points needing clarifica- 
tion can be reviewed at the next meeting of the class (p. 

124). The use of quality circles also has two drawbacks. 

First, "some sacrifice of course material lis] necessary. ' which 
might be more difficult in classes where content is critical. If 
mastery of content is more critical than exposure to content, 
however, it might be necessary to sacrifice some content for 
students to succeed. Second, “quality circles take time and 
require extra planning" (pp. 124-26). 

Many others separately advocated the principal tech- 
niques of TQM and CQI long before they became popular 
on higher education campuses. The use of student commit- 
tees (see Fuhrmann and Grasha 1983 and McKeachic 1986). 
for example, is an idea almost identical to the concept of 
quality circles. A professor would select a committee of 
three to five students and meet with them regularly. 
Committee members would solicit the suggestions of other 
class members (Fuhrmann and Grasha 1983). A variation, 
called a "senior exit interview." solicits the opinions of 
seniors after they haw completed a course (Braskamp and 
Orv 1994). Seniors are selected because they may be better 
able to provide counsel based on a broader perspective. 

A faculty member who uses a student committee could 
ask that committee* members periodically provide him or her 
with summary reports of their findings, w hich could he in- 
corporated into a poll folio in one of two ways. In some in- 
stances. the* summaries could provide evidence of quality 
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teaching. In others, the faculty member could explain how 
his or her teaching changed because of students* comments. 

One professor’s effort to put into practice the basic tenet 
of TQM — the Ixlief that customers know what they want — is 
an attempt to empower her students to make decisions 
about what they should learn (Rhein 199-1). The professor, 
who structures the assignment carefully, allows students to 
write the course outline. She consistently finds that students 
“come up with an outline almost identical to the one she 
would have written." She also finds that students lend to 
“give themselves more work to do than she would have 
assigned" (p. 7). 

A number of other creative ways can be used to gather 
opinions from students or to check on how well they are 
learning what you think you are teaching. One frequently 
used method involves collecting notebooks from a few stu- 
dents and reviewing them. It is true that what is written in a 
notebook might not be what the professor said, but if it is 
written incorrectly (or not at all) in a number of notebooks, 
it may point to a difficulty with the professor's teaching. 
Another method is to use e-mail and voice-mail to not only 
communicate with students but also to assess the effective- 
ness of one s teaching: classroom faculty could set up a 
closed conference on e-mail for students to ask questions 
and make comments about what they are learning and 
about how teaching might be improved. An e-mail account 
could be set up in which students can send the instructor 
anonymous comments about the course (Centra 1993, p. 87). 
/Hie teaching portfolio could include some of the students* 
e-mail messages and the professors reflections on them. 

In another innovative technique, students are asked to 
write a letter to a friend who is considering taking the 
course (Uraskamp. Hrandenberg. and Oiy 1984). The student 
should tell the friend about the course and the teaching. The 
letters should not be signed. Some of these letters or ex- 
cerpts from them might then he included in a portfolio with 
the faculty member's reflection on the students' comments. 

In a course that includes affective goals, a professor might 
ask students to write letters to him or her describing their 
changing attitudes (National Center 1993. p. 2). 

A program at Hrigham Young University pays students to 
observe a class and consult with the teacher (Sorenson 
1994). The student observers, who are invited by the faculty 
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member, receive training that stresses the difference between 
observation and opinion. After consulting with the faculty, 
the student observer assumes one of six possible roles: 

/. Recordei Observer: . . . Student observer record ivhat 
happened in class . . . focusing on how the class pro- 
ceeded, not necessarily what teas taught. 

2. "Faux Student”: Here student observers take notes as . . . 
students enrolled in the class. 7 his role emphasizes 
recordin'* what iras taught rather than how it is taught. 
Filmmaker, 'the students film the class and give the 
ri(leota[.'>s to the instructors. 

4. Interviewer: the professors leave the class 1 5 minutes 
early, and the student . . . lasks studeutsl to write ansuvrs 
to Itbe following (luestionsh . . . W hat should the profes- 
sor keep doing? . . . What should the professor <y,u\ 
doing?. . . What shot tld the professor start doing? 

5. "Primed Student”: Here the professors fell the student 
< thsenvrs what to look for. 

6. Student Consultant: This model implies an ongoing series 
(fohsen-ations and an ei'o/i ing relationship between the 
observed and the ohserretsl Sorenson 199-t. pp. 1 01 -2 k 

Self 

Formative ev aluations can alo include a variety of self- 
evaluation techniques. The use of these techniques, how- 
ever. often raises questions about their reliability and validity. 
When individuals are asked to rate their abilities, they tend 
to rate themselves higher than colleagues or supervisors 
would. And it is unlikely that teachers are an exception. In 
tact, several studies have found low correlations of self- 
evaluations with those from other sources (Centra 1993k 
"For instructional improvement, however, self-ratings can be 
very useful. Studies that compared self- and student ratings 
indicate that teachers identified the same relative strengths 
and weaknesses as students did . . ." (p. 9"). Moreover, an 
exhaustive review of the literature points out that "feedback 
is more effective when information is gathered from oneself 
as well as from others ' (iitinko 1993. p. s”* 7 ). 

Frequently used self-evaluation techniques involve either 
audio- or videotapes of oneself. Audiotapes allow one to 
hear" voice quality, annoying speech tics, and so on. Video- 
tapes allow one to see behavioral tics (such as twirling one's 
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hair, writing on the* hoard with one hand and erasing with 
the other, and so on). By watching a videotape with the 
sound turned off. one can analyze "the visual nonverbal 
elements" of one's presentation (Goulden 1991. p. 2). A pro- 
fessor developing a teaching portfolio might include a 
‘before" and “after” tape with reflection about what he or she 
found on the first tape, what steps he or she took to change 
leaching behaviors, and how successful the effort was. 

Videotaping a class allows instructors to analyze their 
teaching by applying techniques that usually require a teach- 
ing development specialist or a supportive colleague. For 
example, sev eral of the techniques and instalments mentioned 
earlier, such as the behav ior rating form (H. Murray 1987) or 
the TABS instrument, could be used by instructors view ing a 
tape of their teaching. Most authorities strongly recommend 
the use of a checklist to focus the analysis (see, e.g.. Bras- 
katnp and Ore 199 i. pp. 2~3-81; 15. Davis 1993. pp. 338-60; 
Miller 19T. pp. 180-81; VC'eimer. Parnell, and Kerns 19881. 

Colleagues 

The opinions of colleagues about a professor's research and 
publication record have long Ix-en part of the tenure review 
process at most universities. I 'mil quite recently, however, 
few professors would dare consider evaluating a colleague's 
teaching, much less observ e a colleague in the act of teach- 
ing. Nonetheless, the trend is grow ing toward colleagues' 
helping colleagues improve their leaching. The assistance 
can take two forms; colleagues reviewing and critiquing the 
artifacts produced for the course; and colleagues visiting 
colleagues' classrooms, l ew people disagree that a col- 
league in one’s discipline can assist one to improve syllabi, 
handouts, exams, and so on. 

Some skepticism still exists, however, ov er colleagues' 
visiting each other's classrooms. Much of the skepticism cen- 
ters around the notion that colleagues are experts on live 
subject matter, not on pedagogy, and that reliable agreement 
among raters is therefore rare. In fact, “research has shown 
that when colleague ratings of teaching are based solely on 
classroom observation, only slight interrater agreement can 
be expected” (Centra 1993. p. 1 17). But research also dem- 
onstrates that "if peer ev aluators are given proper training 
and experience, their ratings based on classroom observa- 
tions are sufficiently reliable" (Braskamp and Ory 199 t. p. 
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97). Another, potentially more serious, objection concerns 
the tendency of individuals to favor others who act like they 
do (p. 98). Greater reliance on evaluation by colleagues 
could reduce pedagogical diversity within a department or a 
college — a real danger that requires a thoughtful approach in 
the creation of a peer review process. Peer observers should 
be teachers who respect different pedagogical approaches. 

Thus, classroom observation by colleagues works best 
when it is carefully organized. Several conditions are neces- 
sary for creating peer observation teams (Miller 1987, pp. 
77-78). The observ ation team should consist of two individ- 
uals. one of them from the faculty members discipline (or a 
closely related discipline) and the other from a different dis- 
cipline. Members of peer observer teams should be re- 
spected for their teaching ability. The classes to tx.* observed 
should be selected by the teacher, and three to four visits 
should occur. Observers should use some sort of checklist 
(see. e.g.. Braskamp and Ory 1994, pp. 270-72; Centra 1993- 
pp. 209-13; Miller 1987, pp. 106-67: Weimer, Barrett, ancl 
Kerns 1988 for examples of checklists). 

Based on a review of the literature on observation by 
colleagues, colleagues can reliably evaluate; 

1 . Mastery of course content 

2. Selection of course content 
J. Course organization 

4. Appropriateness of course object it vs 

5. Appropriateness of instructional materials (such as read- 
ings. media) 

6. Appropriateness of evaluative devices (such as exams, 
written assignments, reports) 

7. Appropriate) less of methodology used to teach specific 
content areas 

8. Commitment to teaching and concern for student 
learning 

9. Student achievement, based on performance on exams 
and projects 

10. Snppori of departmental instructional efforts (Cohen and 
McKeaehie 1980. p. UK). 

Several models are av ailable for observation by col- 
leagues, A method referred to as "two by two: colleagues as 
partners in faculty a.sse.s.smcnt" (Braskamp and Ory 1994. pp. 
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244—45) involves a minimum of three steps. 'Hie first is to 
get acquainted with the other’s teaching goals. Second is an 
exchange and critique of teaching materials (syllabi, hand- 
outs, exams, and so on). And third is a visit to the other s 
classroom. 

A similar collaborative approach also resembles SGID 
methods (Howe and Moran 1995). Two faculty members 
collaborate to gather data about students and offer each 
other advice on how to improve their teaching. After dis- 
cussing the course objectives, one faculty member visits the 
other class at midterm. 

[He or she! asks the students to identify criteria they use 
to judge the effectireness of the instructor and course. . . . 
After the criteria heuv been agreed upon, the students 
are ashed to discuss bote the instructor and course 
match up with each of these criteria (Howe and Moran 
1995, p. 5). 

The colleagues meet and discuss the strengths and weak- 
nesses and brainstorm "ways to improve the course." Then 
they repeal the process, reversing roles. “The focus of this 
process is on mutual support. How can we do a better job 
with our teaching?” (p. 5). 

Using another method, graduate students in the M.li.A. 
program at the University of Chicago can earn one credit by 
auditing an instructor’s class, conducting interviews with 
focus groups and written surveys of the students, and pro- 
viding the instructor with weekly reports (Centra 199.5). 
Although not colleagues in the strictest sense, these graduate 
students are functioning like colleagues while "learning 
something about teaching" (p. 125). 

Hie Master Faculty program (Katz 19H9) pairs colleagues 
in a highly structured program to improve teaching. Two 
faculty members are paired: one of them is the ’readier, the 
other . , . the Observer. . . . T he observer sits in on the class 
about once a week” (pp. 5— t). both the teacher and the 
observer interview two or three students individually weekly. 
“[They | are not judgmental or evaluative interviews: instead 
the locus is on how the students go about learning — the 
students’ perceptions of the course content, how they exe- 
cute their assignments’’ (p. » ). The colleagues get together 
once a week to discuss the interviews and the observer’s 
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impression of class. At colleges with several colleague pairs, 
all the pairs get together once a month for a discussion. 

Colleagues can also provide valuable assistance without 
observing a class, Perhaps a colleague could review a few 
exam papers after they have been graded to check whether 
the teacher s expectations are too high or too low (Mc- 
Keachie 1986). 

Whatever evaluation techniques are adopted, they should 
he designed to yield detailed information that can he used 
by the profe: sor to improve teaching. Formative evaluation 
works best when •■participation is voluntary, nonthreatening, 
and collaborative — that is. when faculty do not feel the eval- 
uation is being done /othem" (Kahn 1993. p. 122). 

Summary 

Although many items can and should go into a teaching 
portfolio, the heart and soul of a teaching portfolio is the 
assessment of and reflection on the effectiveness of teaching 
and learning. Most faculty members will need some assis- 
tance in designing processes for evaluating their teaching. 
Such assistance can come from the chair of the department 
or a faculty development specialist, but the primary sources 
of knowledge about the effectiveness of Ones teaching are 
students, oneself, colleagues, and administrators. 

Gathering data on one's teaching demonstrates a concern 
for the quality of teaching. A variety of published and easy- 
to-use instruments are available forgathering data from any 
or all of these sources. Several creative and nontradilional 
means of gathering data are also available, some of which 
are adaptations of TQM or CQ1 techniques. It is probably 
true that the method of gathering data is less important than 
the act of gathering them. 

In addition to input from students, faculty can ask col- 
leagues to assess the quality of their teaching, and colleagues 
can provide some valuable insights about materials designed 
by instructors. It is important to remember, however, that if 
faculty are going to visit each other's classrooms, some form 
ol structure is needed, l acu'ty can also evaluate themselves, 
although self-evaluations are less reliable than other forms of 
evaluation 



70 




SHAPING AN INSTITUTIONAL DEFINITION 
OF GOOD TEACHING 



Before colleges and universities can implement teaching port- 
folios, they need to grapple with the task of defining good 
teaching. If colleges and universities intend to include stan- 
dards for good teaching when making personnel decisions, 
they need to he able to recognize good teaching. Moreover, if 
colleges and universities intend to use portfolios to assist 
professors in their efforts for continuous improvement of 
teaching, administrators and professors need to be able to 
recognize good teaching. Professors creating portfolios and 
using some of the assessment techniques described in the 
previous section need some standards for interpreting the 
data. In other words, before we can measure something, we 
need to locate or c reate a properly calibrated yardstick. 

Despite the importance publicly placed on teaching, most 
colleges and universities have neglected to define go<xl teach- 
ing. Professors traditionally have enjoyed great freedom from 
the kind of curriculum and classroom control often found in 
grades K— 1 2. Consequently, professors usually treat teaching 
like a private affair that goes on behind closed doors. Many 
administrators worry that if they intrude too much in this 
private sphere, they will not only anger professors, hut also 
bring accusations of violating academic freedom. Hence, 
administrators tend to rely on rather vague definitions of 
teaching for fear of treading on academic freedom. 

Professors and administrators often argue that "good" 
teaching cannot be defined or that a single definition would 
he woefully inadequate. It is said that teaching is an ineffa- 
ble quality that one either has or does not have, and no one 
can be taught to teach. Research findings in cognitive psy- 
chology. learning styles, and teaching styles are proving 
these statements to be myths, however. This section demon- 
strates that good teaching tv/// be described and that many 
reasonable definitions exist. The definition of good teaching 
depends on the purpose, and definitions will vary if the 
purpose varies. Although some of the literature reviewed in 
this section contradicts other cited studies, each could be 
valid in different settings. 

Colleges can begin to dev elop a communal definition of 
good teaching by encouraging teachers to engage in conver- 
sations about teaching. Many observers (e.g., Astin 1993; J. 
Davis 199*1; Pxlgcrton 1993. Palmer 1993; Shuhnan 1993) 
have argued that teaching will never achieve the status it 
deserves until it becomes “community property" (Sluilman 
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1993) or until we create "good ralk about good teaching’* 
(Palmer 1993). 

'leaching occurs in remarkable isolation of one s col- 
leagues. Professors often enter the classroom, close the door, 
and teach without benefit of peer opinions. While professors 
do not hesitate to seek colleagues’ advice about research, 
they rarely seek advice about teaching. "By privatizing teach- 
ing we make it next to impossible for the academy to be- 
come more adept at its teaching mission. The growth of any 
skill depends heavily on honest dialogue among those who 
are doing it" (Palmer 1993. p. 8). The result is that professors 
"will perform the function conservatively, refusing to stray 
far from the silent consensus on what works’ — even when it 
clearly does not” (p. 8). 

Although a public dialogue on teaching may not produce 
a definitive definition of good or effective teaching, it can 
enrich and deepen our understanding of teaching in all its 
various guises. Such a dialogue, however, must be grounded 
in the differences created by discipline (Cross 1993: Shulman 
1993 k type of student, and institutional mission (Kahn 1993; 
Seldin 1992). 

/!//)■ definition of effective teaching needs to be closely 
connected to the goals of a particular course and the 
objectives of the specific curriculum containing the 
coi/tye. The curricula and course goals should he influ- 
enced hr the type of institution and academic depart- 
ment that offers the course. A philosoph y depailment at 
a research institution offering a course in ancient phi- 
losophy to doctoral candidates trill < or should) have 
(juite different goals I from f a community college offer- 
ing ancient philosophy to satisfy a general education 
degree ret/tiirentent for allied health majors (). P. Murray 
1993b. p. 167). 

Any attempt, therefore, to define good or even effective 
leaching must take into account that "instructional methods 
and content an* discipline-specific, making absolute compar- 
isons both impossible and inappropriate" (O’Neil and Wright 
1992, p. 6). 

Because much of the discussion of how to improve teach- 
ing focuses exclusively on technique, it often seems to he 
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shallow and hollow. Although the hollowness emanates 
from several sources, the primary source appears to be the 
tendency of some to divorce the dialogue about teaching 
from a dialogue about learning. “If deepening the dialogue 
about teaching is the goal, this deeper conversation will 
occur when we talk with faculty in increasingly sophisticated 
ways about learning, when we help them distinguish among 
different kinds of learning, and [when we] encourage them 
to select teaching strategies based cm learning" (J. Davis 
1994. pp. 44-45). 

Colleges and universities have concentrated on the im- 
provement of teaching for a long time, assuming that if 
teachers perfected their techniques, students would automat- 
ically learn — all of which leads to the view that if we can 
make professors better teachers, students will learn. This 
tendency creates a sterile view of teaching that often makes 
no effort to assess how, what, or whether students learn. 
“Student outcomes under the current paradigm are irrelevant 
to the successful functioning of a college” (Barr 1995. p. 2). 
Moreover, faculty development: 

. . . Iqfteul focuses on the improvement of teaching and 
often occurs in splendid isolation from the important 
issues of curriculum content and assessment of student 
i earning outco jies. What appears to he d ere loping are 
three separate literatures . three sets of professional asso- 
ciations (orsnhsidiaiy efforts irithiu associations! It hall 
deal separately and sometimes exclusively with curricu- 
lum planning. improving teaching, and assessment. 

Much of this activity and the emerging literature is 
quite valuable . hut lit! is compartmentalized and spe- 
cialized (J. Davis 1994, p. 45). 

The Current State of Knowledge about 
Good or Effective Teaching 

Three types of literature are generally available regarding 
good teaching — statements of personal convictions based on 
years of observal ions and study (e.g.. l:ble 1988. bowman 
1984). statistical or quantitative studies that seek the opin- 
ions of faculty and/or students, and ethnographic or qualita- 
tive studies. Taken together, they might provide us with a 
comprehensive view of “good teaching*'; howev er, each type 
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of literature has drawbacks. Statements of personal comic- 
tions represent primarily the opinions of the authors and 
cannot lx* generalized without risk. Quantitative studies seek 
the opinions of college teachers and students and often are 
not validated against any criterion of learning. Moreover, 
quantitative studies use statistical techniques to analyze the 
data for commonalities that may overlook important individ- 
ual differences (i.e.. "outliers") in teaching and learning. 
Qualitative studies are also based on the collective opinions 
of the subjects and also are not generalizable. 

Statements of personal convictions 

based on their research, (.'bickering and damson ( 19K~> 
provide one of the most influential statements of personal 
convictions. According to them, in teaching: 

t . Good practice encourages student-faculty contact. 

J. Good practice encourages cooperation anion, students. 

J. Good practice encourages active learning. 

■i. Good practice yit vs prompt feedback. 
s Good practice emphasizes time on task. 

6. Good practice communicates hiyh expectations. 

Good practice respects dit vise talents and nays if learn- 
ing (Chickcring and damson 198”. p. 1). 

Statistical or quantitative studies 

I.ike most statements of personal convict it ms. ('.bickering and 
damson s list emphasizes the quality of teacher-student inter- 
action. A reader will search ibis list in vain for any mention 
of "knowledge of subject matter." w hich nearly all quantita- 
tive studies of good or excellent teaching consider to he a 
major criterion. Statistical studies more often point to teach- 
ers*. rather than students', behaviors or characteristics. 

One study using a Delphi technique, for example, found 
that faculty development leaders in "nationally known leach- 
ing initiatives at a variety of institutions ' believed good teach- 
ing required the 2~ competencies listed in table ~ (Smith and 
Simpson 199S). Meta-analysis of more than “0 studies (l ; eld- 
man I9~b) found that, from students' point of v iew, effective 
teachers demonstrate knowledge of subject matter, love of 
the discipline, and love of teac hing. Students also say that 
effective teachers are organized, clear, and prepared. And 
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another review of the literature found that students consis- 
tently identified eight characteristics in effective teachers. 

1. Knowledge of the subject matter. 

2. Interest in, concern for. and respect for students. 

3. Well preparedAvell organized. 

4. Enthusiasm aboul/interest in the subject matter, 
dynamic, energetic, stimulates interest. 

5. Ability to present material interestingly and clearly. 

6. Openness, respect for opinions of others, encourage- 
ment of questions and discussion. 

7. Fairness. 

8. Helpfulness and availability (Bernoff 1992). 

Studies of excellence in teaching at community colleges 
paint a similar picture. Faculty and administrators at Miami- 
Dade Community College produced the list of "core charac- 
teristics” in table 8 that define excellent teachers. 

Several interesting observations can be made about these 
lists. First, all the lists contain only behaviors, attitudes, and 
qualities that relate to teachers. None speak to the behaviors, 
altitudes, and qualities of students that might enhance their 
learning. Several researchers and theorists, however, are 
now arguing that students have some (not all) responsibility 
for the quality of their learning experiences (see. e g.. 
Gardiner 199-0. Second, only the Miami-1 )ade Community 
College study includes any intended outcomes for student 
behaviors or attitudes. Although these research fin lings arc 
undoubtedly important, they tend to view the teaching- 
learning equation from only one side. 

Ethnographic or qualitative studies 

Qualitative studies of excellent college professors most often 
emphasize the effects on and interaction with students. For 
example, an in-depth qualitative study of five excellent com- 
munity college teachers found that all five exhibited: 

1. A strong command and organization of their subject. 

2. Enthusiasm about their discipline and class presentations: 

3. An approachable and friendly style with students; and 

t. The ability to motivate students to form goals and suc- 
ceed academically (Dubois 1993. p. u68). 



05 



Successful /• acuit y Development and Hraluatum 



75 





TABLE 7 

Competencies Required for Good Teachers 

1 . Provide helpful feedback to students in a variety of ways. 

2. Exhibit respect and understanding for all students. 

3 Demonstrate mastery of the subject. 

-t. Communicate effectively in both written and oral formats in 
English. 

5. Develop a reflective approach to teaching by collecting 
feedback and using it to continually modify the approach to 
teaching. 

0. Promote students' individual involvement through learner- 
centered leaching methods. 

~ Enhance students motivation through personal enthusiasm for 
the subject. 

H. Communicate and manage appropriate expectations for 
achievement in the course. 

9. Demonstrate a general belief that all students are capable of 
learning. 

10. Encourage ooojxTation and collaboration among students. 

1 1. Select course material suited to students' backgrounds, 
abilities, and interests. 

12. Construct valid and reliable tests and administer other 
evaluation measures fairly. 

13- be accessible to students. 

1-t. Match varying teaching methods with specific instructional 
objectives. 

15. Accommodate students’ different learning styles by using a 
variety of teaching methods. 



Excellent community college faculty also: 

1. Spent a considerable amount of time preparing course 
presentations: 

2. Were talented in clarifying difficult subject matter; 

3. Were accessible to students outside class: 

•t. Evaluated their students frequently and always let them 
know where they stood with regard to academic per- 
formance; 

5. Had a strong sense of commitment and dedication to 
community college leaching: 

(>. I nderstood that many community college students 
come from troubled family experiences and lack aca- 
demic skills; 

7 . Were able to convey a strong sense of presence in the 
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16. Present material that is sequenced and paced appropriately for 
learners. 

17. Recognize and accept teaching as a fundamental and 
challenging dimension of scholarship. 

18. Enhance students' motivation by demonstrating the subject's 
relevance to their future needs and goals. 

19. Manage the learning environment so that maximum learning 
will result. 

20. Lead class discussions that stimulate learning and enhance the 
goals oi the course. 

21. Manage the process of planning, teaching, and evaluating in a 
timely manner. 

22 Communicate important values inherent to the discipline or 
profession. 

23. 1 sc research in leaching as it applies to instruction in one’s 
field. 

2't. Build confidence in students by helping them to successfully 
meet learning objectives. 

25. Deal appropriately with issues that relate to various aspects of 
diversity. 

26. Design courses that challenge students to pursue higher-level 
learning. 

27. Deal appropriately with matters of discipline, academic 
honesty, and legal information. 

Source: Smith and Simpson 1995. p. 22K. 



classroom lo elicit students' attention and stimulate their 
emotk >ns: 

8. Never embarrassed or berated students: 

9. Encouraged students' participation: and 

10. Saw themselves as student-centered teachers (Dubois 
1993. p. 464). 

Such teachers dearly are committed to students. 

These results are similar to those of others who have 
studied excellent community college instructors. l ; or exam- 
ple. a study of 289 instructors at community colleges in the 
Midwest concluded that “the most important quality or char- 
acteristic of successful community college instructors is a 
genuine interest in working with a diverse student clientele. 
Success in teaching appears to be focused as much on the 
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TABLE 8 

Core Characteristics for Excellent Teachers 



A. Motintticm. Excellent faculty members at Miami-Dade 
Comnuinity College, whether classroom teachers, librarians, 
counselors, or serving in any other faculty capacity: 

1. Are enthusiastic about their work. 

2. Set challenging individual and collective performance goals 
for themselves. 

3. Set challenging performance goals for students. 

Are committed to education as a profession. 

3. Project a positive attitude about students' ability to learn. 

6. Display behavior consistent with professional ethics. 

7 . Regard students as individuals operating in a broader 
perspective lx*yond the classroom. 

». htlvipcisonal Skills. Excellent faculty members at Miami-Dade 
Community College, whether classroom teachers, librarians, 
counselors, or serving in any other capacity; 

1. Treat all individuals with respect. 

2. Respect diverse talents. 

3. Work collalx)ratively with colleagues. 

•t. Are available to students. 

3. Listen attentively to what students say. 

h. Are responsive to students' needs. 

“. Are fair in their evaluations of students' progress. 

8. Present ideas clearly. 

9. Create a climate that is conducive to learning. 



interaction with students as on tile transmission of content" 
(Higgins. Hawthorne, Cape, and Hell 1993. p. .30. 

Effective community college teachers also have certain 
“hidden characteristics.*' 

1. They overcame childhood hardships and became at- 
tracted to the helping professions: 

2. They were inspired by past teachers: 

3. They have a distinct identity as a teacher* messiah: and 
t. They need students as much as. if not more than, their 

students need ihcm (Du Hois 1993. p. i63). 

It is doubtful that these characteristics are necessary to be an 
effective community college teac her, hut they might provide 
some insight into how and why some individuals become 
effective community college professors, 
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C. Knowledge Base. Excellent faculty members at Miami-Dade 
Community College. whether classroom teachers, librarians, 
counselors, or serving in any other capacity: 

1. Are knowledgeable about their work areas and disciplines. 

2. Are knowledgeable about how students learn. 

3. Integrate current subject matter into their work. 

4. Provide perspectives that include a respect for diverse views. 

5. Do their work in a well-prepared and well-organized manner. 

D. Application of Knowledge Base, Excellent faculty members ut 
Miatni-Dade Community College, whether classroom teachers, 
librarians, counselors, or serving in any other capacity: 

1. Provide students with alternative ways of learning. 

2. Stimulate intellectual curiosity. 

3. Encourage independent ih inking. 

4. Encourage students to be analytical listeners. 

5. Provide cooperative learning opportunities for students. 

6. Give constructive feedback promptly to students. 

7. Give consideration to feedback from students and others. 

8. Provide clear and substantial evidence that students have 
learned. 



Sou tve: McCabe and Jen retie 1990. pp. 189-90. 



Some new faculty members become good teachers and 
others clo not. Interviews of four cohorts of new faculty at 
two universities over a five-year period ( 1985-90) identified 
the seven characteristics that led a few to be successful 
teachers (although the findings paint a bleak picture for any- 
one aspiring to enter the professorial ranks) (Bo ice 1991). 

1. Positive attitudes about students: 

2. Lectures paced in relaxed style so as to provide oppor- 
tunities for students' comprehension and involvement: 

3. Low levels of complaining about their campus, including 
collegial .supports; 

-l. Evidence of actively seeking advice about teaching often 
from a colleague; 

5. A quicker transition to moderate levels of preparing 
lectures: 
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6. A generally superior investment in time spent on schol- 
arly and grant writing (a mean of 3.3 hours per work 
week); 

7. A great readiness to become involved in campus faculty 
development programs. 

Summary 

A necessary first step toward effectively evaluating and de- 
veloping good or excellent teaching is to define excellence 
in teaching. Any definition of teaching, however, must take 
into account differences in disciplines and institutions. More- 
oxer. definitions of effective or excellent teaching will be im- 
poverished if they fail to include a dialogue about whar it 
means to be an effective learner. 

The literature abounds with definitions of effective teach- 
ing. and all are somewhat different. All of these writers anti 
researchers, however, seem to have concluded that excellent 
teachers are ones who care about the hanier as well as the 
learning process. This caring appears in the form of under- 
standing that learners are individuals with individual differ- 
ences. Moreover, excellent teachers believe that their students 
can achieve and communicate this belief in a number of 
ways, including setting high standards. Another striking fea- 
ture of all these definitions is that they emphasize that learn- 
ing and teaching are more effective when dohe collabora- 
tively. Perhaps most important, all conclude that the im- 
provement of teaching and learning is possible and that 
teachers — through their behaviors and attitudes — can make 
a difference. 
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THE ORGANIZATIONAL CULTURE AND 
TEACHING PORTFOLIOS 



Organizational theorists have long recognized that universi- 
ties and colleges develop their own cultures and socialize 
new members into that culture in a variety of ways (Tierney 
and Rhoads 1993). Consequently, change agents need to 
respect the existing culture while at the same time attempt- 
ing to alter it (Fife 1993). Nonetheless, change agents must 
make deliberate, well-thought-out attempts to change the 
culture. "A definition of insanity is to do the same thing the 
same way but expect different results. If institutions wish to 
change their outcomes, they must be willing to examine the 
interrelated activities that make up the system that produces 
the outcomes'* (Fife 1993. p. xiv). This section explores the 
existing culture of higher education and how administrators 
and faculty might go about altering that culture to introduce 
the concept and practice of teaching portfolios. 

Evaluating the Current Reward System 

Concern is growing that ' faculty-bashing is becoming a 
growth- industry" (Edgenon 1993. p. 22 ). and one observer, 
only slightly tongue in cheek, suggests that "such denuncia- 
tions seem well on the way to becoming the cliche opening 
for articles describing the state of higher education in our 
time" (J.R Murray 1993b. p. 163). W hen higher education 
occasionally came under attack in the past, college and uni- 
versity administrators typically dismissed such criticism as 
coming from the uninformed rabble, who. because of their 
lack of education (perhaps also their lack of the ability to 
benefit from a higher education), could not understand the 
lofty mission of higher education. 

Administrators may want to respond proactively this time 
around. While it is impossible to say that the criticisms will 
not fade away, the mood of the public and their legislators is 
quite different this time. The public has come to see higher 
education as a right, not a privilege. 'File rapidly rising costs 
of college, coupled with the perceived decline in accessibility 
for the children of the middle class, generate considerable 
hostility and demands for public accountability. Moreover, the 
public no longer assumes that higher education s leaders arc 
morally and or intellectually superior to other institutional 
leaders. Publicity about scandals involving the misuse of pub- 
lic funds contributes to the feeling that colleges and universi- 
ties are populated with humans no less corruptible and no 
less fallible than those who populate other social institutions. 
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Elected officials have responded eagerly to the public's 
misgivings by introducing legislation to regulate colleges and 
universities. In 1994, Committee C of the AALiP reported that 
“eight states currently have some type of legislation [to in- 
crease the hours professors spend in the classroom) and it is 
under serious consideration in six others" (American Asso- 
ciation 1994. p. 3). As of 1995, Connecticut, Ohio, Maryland 
(which also withheld $21.5 million until universities could 
prove they had increased faculty workload). Massachusetts, 
and Washington had all passed legislation intended to in- 
crease the leaching loads of college faculty, and Colorado, 
Georgia. Minnesota. New York. Oregon, and Wisconsin 
were seriously considering similar legislation (Cage 1995, p. 
A33L Such legislation, while misguided, should send a 
strong signal to higher education. 

liven within the academy, a grow ing number of voices 
advocate change. If we are to take them at their word, the 
American professorial believes that colleges and universities 
must undergo a radical realignment of priorities (Braskamp 
and Ory 1994: Kdgerton 1993). Several studies have shown 
that professors believe that their institutions do not recog- 
nize good teaching, despite the fact that most professors re- 
port that teaching well is an imjx>rtant personal priority. In 
one study of 35.000 professors. 98 percent responded that 
being a good teacher was very important to them: nonethe- 
less. only 10 percent believed their colleges or universities 
rewarded good teaching (Higher Education 1991). A survey 
of 900 full-time faculty teaching in tlu* Iniversity of Cali- 
fornia system found that only “ percent believed the system 
rewarded good teaching (EUgerlon 1993. p. 13). 

Professors have become quite vocal about their belief that 
research brings rewards and good teaching does not. In an 
article reporting on a forum on fac ulty roles and rewards, 
one professor was quoted assaying, *1 fee! pressured to do 
research in order to get rewards for myself, at the expense 
of my graduate students*' C "Thoughts from" 1993. p IS). 
Lesley Stahl, in a recent segment on 60 Minutes, lambasted 
the research culture that pervades higher education. When 
she asked a I niversity of Arizona professor what it look to 
gain tenure, he replied, ‘write and write, and publish and 
publish, and get grants and get grants. “ Alter the I niversity 
of Arizona's provost talked with the professor in an attempt 
to reconcile his disgruntled beliefs with those of the univer- 



82 




sity's administrators, lie remained adamant that publishing 
was the determinant of promotion. The professor told a 
Chronicle off libber liclu cation reporter. "When it comes 
down to an appeal from an associate professor who has 
done what I n c* done with undergraduate education, they 
turn a deaf ear. . . . The message is very clear: leaching 
doesn't count" (“In Box” 1993. p. A16). The chair of the 
Commission of Inquiry on Canadian I diversity Kducation. 
Stuart Smith, put it this way: "It is now politically correct to 
speak favorably of teaching. . . . But a researcher who can 
hardy express an idea outside the laboratory can still make 
it to the top" ( Fennell 1992, p. ST). 

Some inconsistencies are apparent between what profes- 
sors do and what they say. however. Despite the Finding that 
98 percent of faculty claim teaching is very important to 
them, “just 38 percent of faculty in four-year schools say their 
chief interest lies in the classroom: since 1969. the percent of 
faculty agreeing that reaching should lx the primary criterion 
for promotion fell from 78 percent to 62 percent" (Mcacham 
1993. p. -t2). In other words, it may not be only administra- 
tors, alumni, trustees, and donors who covet t lie prestige of 
being connected to a prominently recognized research uni- 
versity. Bui despite the apparent contradictions between pro- 
fessors who say they v alue leaching more than researc h and 
those whose actions say they value research, it is clear that 
faculty are right when they claim that their institutions value 
research. Clearly, the rewards go to the researchers. 

Rewards for Research 

Researchers found that at four-year colleges and universities, 
the amount of time spent teaching or in contact with stu- 
dents was inversely proportional to salary. "Overall, faculty 
arc paid a low of $3t.30 7 if they spend more than "2 per- 
cent of their time teaching and a high of $S6, 181 for spend- 
ing less than .V> percent of their time leaching" (National 
Center 1993, p. I). In contrast, “salaries range from a high of 
$30,060 for those spending more than 3 i percent of their 
time on research to a low of S 30. 389 for those spending less 
than 3 percent of their lime on research" (p. 2). 

The 1987-8.8 National Survey of Postsecondary Faculty 
(t.»81 faculty) I on ml that teaching is woefully unrewarded 
and consequently neglected at four-year colleges and uni- 
versities ( Fairwcathcr 1993). The reason for the neglect of 
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teaching in favor of research is quite dear. “The more time 
faculty spend on teaching, including hours in the classroom, 
the lower the pay" Cp. 46). The exceptions are said to be 
four-year undergraduate liberal arts colleges and community 
colleges. A close examination of the tables in the report, 
however, reveals that even this statement is misleading. Al- 
though those who spend more time teaching at liberal arts 
institutions do receive slightly better pay than colleagues at 
the same institution who spend less time teaching, they on 
the average are still compensated at a lower level than their 
colleagues at research institutions. Moreover, even at liberal 
arts institutions, where research and publication ostensibly 
are less emphasized, "the more time spent on research and 
the greater the scholarly productivity . . . the greater the 
pay" (p. 46). Community colleges arc not included in these 
data and. because they publicly pronounce themselves dedi- 
cated to teaching over research, may be an exception. The 
lack of emphasis on research at community colleges, how- 
ever. does not automatically mean that teaching is empha- 
sized. The few studies available on community colleges, for 
example, suggest that good teaching is not consistent ly- 
re warded (J.P. Murray 1995a). 

Despite* the glowing criticism, enthusiastic defenders of 
the research culture still exist. Peter Frost, associate dean of 
the Faculty of Commerce and business Administration at the 
University of British Columbia, maintains that "the bias is to- 
wards research because it is the research that keeps tilings 
moving forward" (quoted in Fennell 1992. p. 58). "Keeping 
things going" means many things to administrators. For 
most, it means attracting financial support in the foim of 
large grants and gifts, 'file financial support, according to the 
defenders of the research culture, is what attracts graduate 
students (Fennell 1992). Moreover, in response to Lesley 
Stahl’s story on 60 Minutes, Gniversiiy of Arizona President 
Manuel T. Pacheco circulated an e-mail answer that argued 
that research dollars pay for "80 percent of the equipment 
used by our undergraduates in science" and "have con- 
structed buildings, outfitted laboratories, and supported 
thousands of |stiulents| with on-campus jobs that give them 
real-world experience in their career field." 

Some argue that research keeps universities not only 
financially healthy, but also intellectually healthy. William 
Leggett, academic vice president at Montreal's McGill Uni- 
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versity, says that "unless a professor is at the forefront of his 
discipline, he will he reduced to lecturing from a textbook. 

. . . The best teachers appea. capable of balancing both func- 
tions" (Fennell 1992. p. 58). Despite such claims, researchers 
have not been able to find a positive correlation between 
being a good teacher and being a productive researcher. 

Even if a correlation exists between effective teaching and 
productive research, it is unlikely to affect undergraduate 
education. In fact, the average correlation in one study was 
about .13 (Feldman 1987). Moreover, at most universities, 
researchers are released from classroom responsibilities if 
they secure sufficient grant funding. "Recent studies by uni- 
versities in several states found that, on average, full-time 
faculty taught less than one-quarter of all undergraduate 
courses. . . . Research cannot enhance undergraduate teach- 
ing when the full-time faculty doing research arc not teach- 
ing undergraduate students" (Fairweather 1993. p. 44). 

Keen when campuses attempt to reward good teaching, 
they sometimes do things that hurt more than help. For 
example, the University of North Carolina at Chapel Hill 
awards a three-year distinguished teaching award that pays 
an annual bonus of $5,000. At the end of the three years, 
however, the money goes away (Meacham 1993. p. 4i). in 
other words, being excellent at teaching can lead to a tem- 
porary salary increase and a drastic salary reduction when 
the award expires. In most cases, professors who win salary 
increases for productivity in research do not lose the in- 
crease even if their productivity falls off. 

Despite the tendency to put the conflict between research 
and teaching in extreme terms, the resolution may not re- 
quire a radical restructuring of colleges and universities. The 
real conflict appears to be balancing the need for both and 
rewarding teaching equally with research, balancing the two 
starts with the recognition that both arc time-consuming. 
Effective teaching takes time away from research, and. with 
the average professor’s work week now estimated at 5a 
hours (Edgerton 1993. p. 13). the time to teach well must 
come from the time a professor devotes to research or to 
family. Colleges and universities must find ways to balance 
the conflicting claims research and teaching make on a pro- 
fessor s time. Moreover, and most important, administrators 
must find ways to demonstrate that they value good teach- 
ing no less than they value good research. 
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Changing the Reward Structure to Emphasize Teaching 

The pivotal first step requires institutions to examine critically 
w hat they value, for what institutions value is ultimately 
reflected in their reward structure. On the whole, four-year 
colleges and universities reward research, and until this situa- 
tion changes, in action as well as in word, teaching will 
always take a distant second place to publications, grants, 
and the other public marks of the researcher. It “is futile to 
talk about improving the quality of teaching if. in the end. 
faculty are not given recognition for the time they spend 
with students'* (Boyer 1990. p. xi). A critical first step to rec- 
ognizing and rewarding gixxl teaching is to develop effective 
ways to assess teaching performance. The primary argument 
of this monograph is that teaching portfolios provide a supe- 
rior means of assessing teaching and improving learning. 

Appraisal of teachers' performance must be individualized 
for it to ultimately affect teaching (Blackburn and Pitney 1988). 
Individualization in teaching is threatened by the typical way 
it is assessed, namely, by student evaluations. . . . They esta!> 
lisli a uniform set of standards and assume that certain behav- 
iors are good, and the absence of those behaviors constitutes 
proof of poor teaching” (p. 32). Even if the uniform set of 
standards arc valid, student evaluations alone appear to have 
little impact on the improvement of teaching (Oty 1991). 
Therefore, something more is needed if colleges and universi- 
ties seriously desire to improve teaching through appraisal of 
performance. "A portfolio system would accomplish the goal 
of continuous growth and development, the realization of the 
individuals full potential" (Blackburn and Pitney 1988. p. 32). 

The individualization of the evaluation of teaching pro- 
vides the power and promise to the portfolio movement. 
Portfolios allow individuals to document what they do. how 
well they do it. and. most important. //•/>]■ they do it. In other 
words, portfolios provide instructors with a means to “ex- 
press in their own way the unique aspects of their teaching 
and the variety of reliable data IthatJ demonstrate it" (Payne 
1991. p. ^). Thus, "poii folios enable teachers to document 
their teaching in an authentic setting and to bring in the 
context of their own classrooms. . . . And when the actual 
artifacts of teaching arc combined with a teacher's rellec- 
lions. portfolios permit us to look beneath the surface of the 
performance itself and examine the decisions that shaped a 
teacher’s actions" (Wolf 1991, p. 13(>h 
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Portfolios provide an authentic assessment that connects 
context to outcomes in a concrete, individualized manner 
befitting a professional. Portfolios empower a professional to 
take charge of his or her professional life and critically re- 
flect on it with an eye toward improvement. "The process 
forces them to (1) think about their teaching activities; (2) 
assess priorities: (3) ponder teaching strategies; and (4) plan 
for the future. . . . The teaching portfolio is an effective tool 
for instructional improvement because it is grounded in 
discipline-related pedagogy" (Seldin 1992, p. 14). 

Among the advantages that teaching portfolios bring to 
higher education, two are of importance to those wishing to 
alter the culture of higher education. First, portfolios can he 
powerful instruments for the improvement of teaching; that 
is, they can combine evaluation and faculty development. 
Second, teaching portfolios provide a means to publicly 
showcase and reward effective teaching while acknowledging 
differences in disciplines. Although certain common pedagog- 
ical principles cut across the disciplines, certain clear differ- 
ences are grounded in the disciplines. “Teaching goals in the 
disciplines are visibly and legitimately different. ... If teach- 
ers from different disciplines have different teaching goals, 
then a variety of measures must be used to assess teaching 
effectiveness" (Cross 1993. p. 220). Obviously, student rating 
forms that reduce assessment of the effectiveness of teaching 
to a set of behaviors common to all disciplines cannot ac- 
count for the differences among disciplines. Teaching portfo- 
lios can. because they force teachers to ask themselves about 
what they teach and why they teach it. Only others from 
one's discipline can assist in answering these questions. 

Although examining and changing the reward structure is 
a necessary first step for any college or university desiring to 
emphasize the importance of teaching, it is not sufficient to 
unseat the dominant culture of "the researcher. * Nor is it 
likely to sell the concept of teaching portfolios to a cynical 
faculty that believes teaching does not count .for much. Re- 
cently, the dean of the School of Hducation at a Research I 
University said, “Teaching can t get you tenure, but bad 
teaching can get you fired." Another Research I University 
proudly announces in its catalog that it honors authors of 
one or more hooks with membership in a special faculty 
club and that those who publish a substantial number of 
articles in peer-reviewed journals also have their own faculty 
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dub. being intelligent folk, faculty obviously get the mes- 
sage when they cannot find a club for honored teachers 
with mediocre publishing records. The sad part is that such 
activities are so ingrained into faculty members' thinking that 
they are rarely offended by the dear emphasis on research 
over teaching. 

Introducing the concept of teaching portfolios at such uni- 
versities is likely to be greeted with the same enthusiasm a 
screen door salesman receives on a submarine. Although 
both examples in the previous paragraph came from re- 
search universities, the climate is not likely to be any wanner 
on four-year liberal arts or community college campuses. 
Many four-year liberal arts colleges aspire for equality with 
their university counterparts and believe placing more em- 
phasis on research and publications will achieve this goal — 
witness the number of undergraduate liberal arts institutions 
that have recently dropped the word “college” from their 
name in favor of "university," Moreover, even at undergradu- 
ate liberal arts institutions, those with better publication 
records receive higher pay (Pairweathcr 1993). Community 
colleges may not emphasize research and publication, but 
their faculty frequently tend to react negatively to any 
change in the way they are evaluated. 

Other Changes Needed 

Understanding the culture of the organization and bow 
change can be effectively introduced is necessary if the con- 
cept of teaching portfolios is to be successfully introduced. 
Several aspects of an academic institution s culture must be 
respected if the change agent is to be successful, and several 
aspects are critical if teaching portfolios are to be success- 
fully introduced on campus. 

hirst, faculty must be convinced that the idea is a good 
one and will benefit them (Kremer. Malik, and Mazer 1993: 
Seldin and Annis 1990). faculty are often deeply suspicious 
of any new evak. uion technique (J.P. Murray 1994b) and 
must be assured that it will not he used against them. Ad- 
ministrators should be very candid about the purpose and 
anticipated outcomes of any evaluation technique (black- 
burn and Pitney 1988), and faculty should be involved in 
deciding "the criteria to Ik* used. . . . the evidence by which 
performance will be appraised, and . . . the manner in 
which the evaluation will lx* conducted” (p. 38). Moreover. 
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faculty will need assurances that the benefits merit the time 
they put into developing a portfolio (Robinson 1993). 

Second, the support and cooperation of colleagues is 
critical to the success of any portfolio project (Blackburn 
and Pitney 1988; J.P. Murray' 1994b; Sddin and Annis 1990). 
The development of a portfolio involves significant risks for 
the developer. He or she may discover imperfections, defi- 
ciencies. and attitudes he or she never suspected. It also 
means displaying one s warts to colleagues and chair. The 
risks are significant and should never be taken if one is not 
in a supportive, collegial relationship with one s colleagues. 
Although it is an individual’s portfolio, it is the result of a 
group effort. When petty jealousies, backbiting, and grudges 
rule the department, the risks inherent in developing a port- 
folio unquestionably outweigh the benefits. Colleagues need 
to be more than simply neutral; they must be supportive and 
cooperative. 

"In practice, the well-knit portfolio usually represents 
collegial efforts. Most people need help from some ‘other — 
a teaching improvement specialist, a faculty colleague, or a 
department chair — to structure the portfolio and decide what 
goes in it” (Seldin anti Annis 1990. p. 198). At many steps 
along the way, faculty will need the assistance of a “col- 
league. ’’ someone who can share their ideas, hopes, fears, 
successes, and failures and someone who can offer sugges- 
tions and feedback. This person needs to be a colleague in 
the sense of an “associate” or a “fellow traveler” rather than 
one who judges in the tradition of a peer evaluator. 

Although support from colleagues across the campus is 
important, the support of departmental colleagues is indis- 
pensable. 

Portfolio derelopment and use must be situated in 
departments for disciplinary reasons as well. Episte- 
mologies differ across disciplines . and so do fundamen- 
tal ideas about teaching, it is important for colleagues 
within the same discipline to grapple with issues of what 
constitutes effect in* teaching in their field (Corbin 199i. 
p. 102). 

Moreover, at universities and senior colleges, faculty mem- 
bers' loyalty is first to their discipline and second to their 
university. Kvcn at community colleges where loyalty Lo 



Successful Faculty Derelojunem and EraluatUm 



89 



79 




one's discipline is less, faculty tend to respect the opinions 
of departmental or divisional colleagues over those of ad- 
ministrators — especially with regard to matters of teaching. 
And legitimate differences exist among disciplines that affect 
the definition of good teaching. 

It should he noted, however, that faculty seeking mentors 
to assist them with the development of a portfolio need not 
look exclusi\ely within their own discipline. Despite the is- 
sues of loyalty and differences in teaching objectives between 
disciplines, it can be aigued that someone from another disci- 
pline can still he an effective mentor. In fact, someone from 
outside one's own discipline may find it easier to focus on 
teaching than on content (Annis 1993). 

Third, all college and university administrators, including 
the president, must provide enthusiastic and public support. 
Adequate resources are a necessity (Blackburn and Pitney 
19SS). The improvement of teaching must become an insti- 
tutional priority supported by top administrative officers 
(Cross 1993; Green 1990: Kreiner. Malik, and Ha/.er 1993; 
Scldin 1993b; Stevenson 199S). ‘Significant change simply 
does not happen unless the people who work in an institu- 
tion understand that the chief executive officer and the col- 
lege's leadership are committed to that change" (McCabe 
and Jenrette 1990. pp. 19-I-9S). 

Moreover, administrative support is a necessary condition 
for implementing changes to any performance appraisal 
system, especially portfolios because they depart radically 
from the traditional evaluation systems (Blackburn and 
Pitney 19HH: Scldin 1993b: Scldin and Annis 1991-92). An 
attitude of trust must exist between faculty and administra- 
tion (Blackburn and Pitney 1988). "Administrators must vig- 
orously and publicly commit themselves to the portfolio 
concept and provide the necessary financial support" (Seklin 
1993b, p. 91 ). Administrators must be made to understand 
that for teaching portfolios to be effective, it is necessary 
that they surrender some control over evaluation and evalu- 
ation standards to the faculty. Some administrators will need 
to be reassured that individualizing the process of evaluation 
will not result in faculty members' slick presentations of slim 
products. It is not possible to present the appearance of 
good teaching if the evidence does not exist (Scldin 1992). 

Although support for teaching portfolios must come from 
tlie president, deans, and academic vice presidents, the key 
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players in this process are department chairs (J.R Murray 
19951')). Chairs and other “first-line" administrators may need 
education or training to be thoroughly familiar with the con- 
cept and the purposes of teaching portfolios (bison 1993; 
Kremer, Malik, and Hazer 1993; Seldin 1993b). The impor- 
tance of providing training for administrators before imple- 
menting the assessment of teaehing portfolios can be il- 
lustrated by two very different experiences at two higher 
education institutions — a successful effort to introduce port- 
folios at a large community college (McCabe and Jenrette 
1990) and a failed effort at a university (Robinson 1993). A 
salient difference is that, at the community college, adminis- 
trators were provided extensive and thorough training be- 
fore faculty created portfolios. At the university, adminis- 
trators received no training, before or after faculty devel- 
oped portfolios. 

Administrators need to communicate that they and the 
institution are committed to the project. Commitment means 
that the result of a portfolio will mean something. It does 
not always mean that any and all efforts will automatically 
be rewarded. In some cases, appropriate resources may 
need to be placed at the disposal of the faculty member or 
the chair for improvement or renewal, lhu if honest intro- 
spection or reflection about teaching is to occur, it all must 
be done without any potential harm to faculty members 
who willingly take a risk and develop a teaehing portfolio. 
Administrators will find themselves walking a narrow line 
that allow s them to support and encourage the development 
of portfolios but prevents them from taking unilateral action. 
Administrators must be trusting (sometimes almost blindly 
trusting) that the teacher and his or her departmental col- 
leagues will "do the right tiling." 

Fourth, important to this endeavor is training graduate 
students to teach. It is time to introduce the pedagogy of 
teaching into the education and indoctrination of graduate 
students. For loo long, graduate students have been edu- 
cated to become researchers, i.c., clones of their professors. 
Hie truth of the matter is that few go on to become re- 
searchers of note, but many go on to teach. Nearly half a 
century ago, Blcgen and Cooper remarked, " Hie American 
college teacher is the only high-level professional . . . who 
enters upon a career w ith neither the prerequisite trail of 
competence nor experience in the use of the tools of bis 
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profession" (quoted in Seldin 1993b. p. 209). The typical 
newly minted PhD. is still thrust into the classroom without 
any formal education in teaching and must learn by trial and 
error. Although many become adequate teachers and some 
even become good teachers, they do so on their own. The 
sad part of this on-the-job training is that it is unnecessary, 
livery' university engaged in educating graduate students has 
adequate resources to provide structured experiences that 
could benefit those who go on to teaching positions in 
higher education. A few universities are awakening to this 
need and creating programs to develop graduate students’ 
teaching skills (see. e.g.. Centra 1993 for a description of 
such a project at Syracuse University). Unfortunately, these 
programs are few and far between and often not part of the 
requirements for a doctorate. When they are not required, 
advisers (some of whom often express disdain for "peda- 
gogy courses’ ) will not urge their graduate students to take 
them. And without such encouragement, graduate students 
will not bother. Universities should strongly consider adding 
a “teaching component" to all graduate degrees, especially 
for master's-level programs, whose graduates tend to find 
positions teaching at community colleges. 

Fifth, faculty need to feel ow nership of the process 
(Green 1990; McCabe and jenrette 1990; Seldin 199.3b). In- 
volving faculty in the decision-making process is a necessary 
condition for the success of any innovation in higher educa- 
tion. In addition to higher education's strong cultural bias 
toward shared governance, researchers reassure us that “par- 
ticipation tends to produce acceptance and joint ow nership 
over . . . |a| decision’’ (Yroom and Jago 19HH. p. 5?). An 
unsuccessful attempt to introduce teaching portfolios to 
three departments at Old Dominion University was partly 
the result of not involving the faculty in the planning pro- 
cess before portfolios were introduced (Robinson 1993). 

Faculty, in particular, should he involved in developing 
the criteria for evaluating the quality of teaching (Kremer, 
Malik, and I Inzer 1993) and for assessing the quality of the 
portfolio, "before any thought is given to professional portfo- 
lio construction, scholars should clearly understand what 
their institutions expect of them in terms of professional 
work and what evidence of successful performance is 
deemed appropriate" (Froh, Gray, and Lambert 1993. p 106). 
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Faculty also need clear guidance on how to develop a 
portfolio and what might go into it (Seldin 1992), and failure 
to provide such guidance can spell disaster for a campus port- 
folio project (Robinson 1993). “Some institutions have found it 
helpful to make available portfolio models of exemplary, 
satisfactory’, and unsatisfactory quality" (Seldin 1992, p. 1 4). 

Sixth, a key component to making teaching a prominent 
and valued component of a college's or university's culture is 
the establishment of an effectiv e and respected faculty dev el- 
opment program (Green 1990; Rice and Austin 1990; Seldin 
1993b). It is simply insufficient to promote excellence in teach- 
ing without providing a means for faculty to gain the under- 
standings and skills needed to become effective teachers. 

Summary 

Criticisms of the academy recently have increased in inten- 
sity and attracted unwanted attention from state legislators, 
and a number of state legislatures have passed or are con- 
sidering passing laws that would regulate colleges and uni- 
versities. Attempts to legislate the number of courses a pro- 
fessor must teach, the size of classes, and time spent with 
students have become increasingly intense. These misguided 
efforts arise, in pail, out of a misunderstanding of what 
teaching entails, but the criticisms also arise out of a growing 
belief that teaching is neither a priority nor done well at 
universities and colleges. Much of the criticism is coming 
from within the academy. Clearly, higher education officials 
must take such criticisms seriously and attempt to elevate 
teaching to a status equal to that now enjoyed by research. 
Teaching portfolios provide administrators with a means to 
start this process. 

A critical first step to introducing teaching portfolios to 
college or university faculty is understanding the culture of 
that institution. The reward structure of colleges and univer- 
sities clearly encourages professors to neglect teaching in 
favor of research; the dominance of the research culture is 
partly the result of the difficulty in objectively evaluating 
teaching. Most colleges and universities presently rely on 
computer-scored student evaluations of faculty. Such ev alua- 
tions. however, tend to measure the common denominators 
of teaching and neglect the differences resulting from disci- 
pline. institutional mission, students' goals, and so on. Again. 
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teaching portfolios provide administrators with a means to 
individualize the evaluation of teaching. 

College administrators must take several actions to change 
the culture of a college or university. First, they must con- 
vince faculty that teaching portfolios will benefit them. Sec- 
ond. they must get colleagues to support one another. Third, 
all college administrators, including the president, must pro- 
vide strong vocal and public support for the concept. Fourth, 
administrators must attempt to alter the way graduate stu- 
dents are socialized into the teaching profession. Fifth, ad- 
ministrators must give faculty ownership of the process. Sixth, 
administrators must establish an effective and respected fac- 
ulty development program. 
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THE ROLE OF DEPARTMENT CHAIRS 

If colleges and universities wish to alter their culture to 
value excellence in teaching, they must start with depart- 
ment chairs. Colleges and universities are organizations 
where “the power for decision making lies at the bottom 
rather than the top” (Fife 1982). Departments set the course 
for a university by means of the decisions they make. By de- 
ciding whom to hire, whom to grant tenure, and whom to 
promote, departments create the values of an institution. A 
department that denies tenure to an excellent teacher with a 
mediocre publishing record sends the clear and distinct mes- 
sage to all untenured junior faculty that teaching counts less 
than research. 

It has almost been taken for granted that the quality of a 
university or college is determined by the quality of its de- 
partments. "Almost all will agree that the stature of individ- 
ual departments largely determines the stature of the in- 
stitution" (Bennett 1983, p. 32). Accordingly, the success of a 
college or university in achieving its mission depends heav- 
ily on the willingness of its academic departments to buy 
into the institutional mission. Therefore, those interested in 
achieving and sustaining excellence in education need to 
begin at the departmental level. “The likelihood of getting 
faculty' involved in the improvement effort and generating 
strong interest in both process and the outcomes is greater 
where they are more likely to share interests, values, per- 
spectives. and responsibilities. Thus . . . efforts to examine 
and strengthen educational quality are optimally conducted 
at the department level" (Hartnett 1973. p. 61). 

The Importance of Department Chairs 

If the quality of academic departments is vital to the w ell- 
being of colleges and universities, then the quality of depart- 
mental leadership is critical. In fact, “the most powerful pre- 
dictor of organizational effectiveness in colleges and universi- 
ties is administrative behavior. Results from . . . research show 
that administrators are more important than environment, 
structure, age, institution type, and control in accounting for 
performance" (\\ hetten and Whetten 1983. pp. 33-36). 

If an organizations effectiveness largely depends on 
administrative behavior, it seems reasonable that chains, by 
virtual of their sheer numbers, are key players — an estimated 
30,000+ department chairs in four-year colleges and univer- 
sities alone (Cimelch and Miskin 1993). If two-year colleges 
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are included, the number nearly doubles. In all. it is likely 
that chairs ouinum!>er all other administrators by five to one. 
And because much of the power within higher education 
institutions rests in departments, it also seems reasonable to 
conclude that chairs are key players. Therefore, when at- 
tempting to develop a culture that values and rewards excel- 
lence in teaching, the most important administrator within a 
college or university is the department chair. "An institution 
can run for a long time with an inept president but not for 
long with inept chairpersons" (Peltason 198-4, p. xi). More- 
oxer. the importance of departmental leadership is no less 
critical for two-year colleges than for four-year colleges. 

The success of individual community colleges in the 
decades ahead trill depend upon their ability to re- 
spond quickly to the educational needs of their service 
area with relevant . high-quality it ist ruction furnished 
via a flexible deliveiy system — and at a competitive 
cost. Given this charge and the organizational chart of 
a typical commit nity college, any beginning student of 
organizational behavior ivould quickly point to the 
first - lei vl supervisor, the clepartment/diiision head, as a 
key determinant in the future of the community college 
(Hammons I98i. p. M). 

Research strongly supports the conclusion that the depart- 
ment chair is the essential player in creating and sustaining a 
departmental culture that supports and encourages excel- 
lence in leaching, based on interviews with over 300 faculty 
from eight institutions, the chair may well represent the 
single most important factor in determining whether or not a 
department actively supports teaching," and an effective and 
determined chair can significantly affect and cause "revolu- 
tionary changes" within a departmental culture that does not 
value teaching (Massey. Wilgcr, and Colbeck 199a. p. 17). 

Characteristics of Excellent Departments 

An investigation of the features that "constrain faculty in 
their ability to work together on teaching” (Massey. Wilgcr. 
and Colbeck 199*1. p. 11) and characteristics of departments 
that support effective teaching" (p. It) identified three fac- 
tors that hinder or prevent departments from creating a cul- 
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ture that holds excellence in teaching in high regard (see 
table 9). Ir _*restingly, the research-versus-teaching 
dichotomy is only part of the reason that excellence in 
teaching is not valued at some institutions. In fact, excel- 
lence in research and excellence in teaching arc equally 
respected and expected at some colleges and universities 



TABLE 9 

Departmental Features Supporting or Constraining 
Effective Teaching 



Features Constraining Faculty 


Characteristics of De- 


in Their Ability to Work 


partments that Support 


Together on Teaching 


Effective Teaching 


Fragmented communication 


Frequent interaction among 


patterns that isolate faculty 
and prevent them from 


the faculty 


interacting around issues 
of undergraduate education 

Tight resources that limit 


Tolerance of differences 
Generational equity 


opportunities and strain 


Workload equity 


faculty relationships 

Prevailing methods of 
evaluation and reward 
that undermine attempts to 
create an environment 
more conducive to faculty 
interaction 


Course rotation 


Source: Adapted from Massey. Wilger. 


and Colbeck IW i. 



“Reward structures offer only a partial explanation for the 
lack of effective undergraduate teaching. Of equal impor- 
tance are broader questions about the organizational context 
within which undergraduate teaching occurs" (Massey. 
Wilger, and Colbeck 1994, p. 1 1). Foremost among the fac- 
tors that negatively affect a department's culture in valuing 
excellence in leaching is "fragmented communication pat- 
terns" (p. 1 1). Five organizational elements contribute to 
dysfunctional communications in a department — autonomy, 
specialization, lack of civility, generational splits, anti per- 
sonal politics (Massey, Wilger, and Colbeck 1994) — and each 
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one causes departmental faculty to avoid talking among 
themselves about any substantive issues, including the 
improvement of teaching. 

On the other hand, “exemplary departments are distin- 
guished by la] supportive culture for undergraduate teach- 
ing, frequent interaction among faculty, tolerance of differ- 
ences. generational equity, workload equity, and course 
rotation. Also important are peer as well as serious student 
teaching evaluation, balanced incentives, consensus decision 
making, and, above all. effective department chairs” (Mas- 
sey, Wilger, and Col beck 1994, p. 14). Although these fea- 
tures of exemplary departments certainly entail more, at 
heart they all point to effective and frequent communica- 
tions among departmental members — in a word, ‘collegial- 
tty.” "Collegial organizations emphasize consensus, shared 
power, consultation, and collective responsibilities — commu- 
nities in which status differences are de emphasized and 
individuals interact as equals. Members of collegial organiza- 
tions share aspirations and commitments, have frequent 
face-to-face interaction, and use civil discourse” (Massey. 
Wilger. and Colbeck 1994, p. 18). 

The Chair and Leadership 

Collegiality must be deliberately and carefully constructed; it 
does not happen without conscientious and deliberate lead- 
ership. Department chairs must provide that leadership; 
however, leadership in the academy takes a different shape 
Iron, what it might take in other types of organizations. 
Collegiate faculty value their independence and their shared 
responsibility — a paradox that means colleges and universi- 
ties require leaders who can facilitate the work of others 
without imposing a structure that stifles that work. 

The ability of the formal office holders to exercise their 
leadership depends upon the ongoing support or compli- 
ance if other leaden and those heiu g led. hi such a sit- 
uation. the leaden hip roles of those in formal positions 
of organizational authority could more appropriately he 
seen as those who facilitate or empower rather than 
those trho t‘of//ro/(Seagrcn. Creswcll. and Wheeler 
1993. p. 21). 



It would be a mistake, however, to assume t hat a chair 





cannot be both a facilitator and a leader. Chairs can set a 
course for an academic department — what some call a mis- 
sion statement (Diamond 1995 ) and others a vision (Cam- 
eron and Ulrich 1986 ; Creswell, Wheeler. Seagren, Egly, and 
Beyer 1990 ; Gmelch and Miskin 1993 ; Seagren. Creswell. 
and Wheeler 1993 ). But to achieve that vision, they must 
bring others along with them. In the jargon of leadership 
studies, this ability is called ‘ transformational leadership.” 

As the name implies, transformational leadership in- 
volves a process of fundamental change. 7 bis change 
results in a new nay of interpreting reality . in a differ- 
ent set of motives, in a higher vision of possibilities, not 
merely in the implementation of alternative actions or 
plans. It is as much concerned with helping people 
think differently about the problems they face as it is 
with creating solutions for those problems. It is as much 
the management of meaning as it is the management 
of substance (Cameron and Ulrich 1986. p. 12). 

Creating Change 

Chairs who desire to transform the culture of the department 
in ways that celebrate excellence in leaching should pay 
close attention to process as well as to leadership style. The 
process of change involves five stages: 

1. Creating readiness: 

2. Overcoming resistance: 

3. Articulating a vision; . 

i. Generating commitment; 

5. Institutionalizing implementation (Cameron and Ulrich 
19H6. p. 13). 

In many ways, the process of transforming a department to 
value teaching boils down to two necessary skills for chairs: 
communicator and facilitator. Change agents with excellent 
communication skills can collaborate with faculty to shape a 
vision for the department. Numerous studies have consis- 
tently found that effective and respected chairs possess ex- 
cellent interpersonal communication skills (Creswell et al. 
1990; J.P. Murray 1992). 

Skilled communication and facilitation skills enhance a 
chair's ability to create readiness, ov ercome resistance, and 
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generate commitment, and tiius effectively generate meaning- 
ful change. In creating readiness, chairs would be wise to 
take the time to build consensus (Creswell et ai. 1990; J.P 
Murray 1993). Building a consensus for change takes time, 
and for change to be more than a transitory blip in the his- 
tory of a department, it is absolutely necessary to take that 
time. Faculty will not assist in bringing about change and 
may even resist change if they do not believe in the outcome. 

The key to transforming a department is the creation and 
articulation of a common vision. While chairs must be the 
individuals who articulate and doggedly promote the vision, 
they should not unilaterally create the vision. 

I 'is tuft is the means by trhich a chair can create a focus 
or agenda for the departments current and future plans. 
Ihe chair does not invent a vision and then attempt to 
impose it on disbelieving colleagues: rather the chair 
facilitates the debate and discussion through which the 
department clarifies its options and becomes aware of its 
fxrssibilities. Ihe chair then oversees the strategies by 
which those fragments of a future are crystallized into a 
shared set of goals and a plan by which to reach them 
(Seagren. Creswell. and Wheeler 1993. p. 20). 

Academics often distrust administrators and, above all else, 
value participation in the decision-making process (J.P. Mur- 
ray 1992. 1993) These two characteristics of fac ulties spell 
doom to any chair with the temerity to skip consensus 
building. According to a participant in a national study of 
excellent department chairs. “Don't do anything your faculty 
did not initiate. Remember the bubble-up theory — nothing 
should lx* done that doesn’t come from the Faculty" (Cres- 
well et al. 1990. p. 24). 

Such advice should not be construed to mean that the 
chair cannot help form the bubble or clear obstacles for 
fragile bubbles to percolate to the top. Excellent department 
chairs provide what another participant of the study called 
“atmospheric guidance" (Creswell et ai. 1990, p. 32). And 
excellent communication skills are essential for atmospheric 
guidance. The research demonstrates that chairs judged 
excellent by their peers are seen as excellent communicators 
(Creswell et al. 1990; J.P. Murray 1992. 1993). 
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Once a chair decides to articulate a vision of excellence in 
teaching, it becomes necessary to determine a starting point. 

In reality, several starting points are likely, each needing dif- 
ferent approaches. Ideally, the best place to begin is the hir- 
ing process. Any chair who can start by hiring a number of 
new faculty would have tremendous power to shape the 
future of the department. Unfortunately, most college and 
university chairs do not have this opportunity: Most chairs 
inherit existing departments w ith existing departmental cul- 
tures. Therefore, to facilitate change, chairs must develop 
support among the existing faculty. No one thing can he more 
disastrous to a chair who is attempting to set a new course for 
the department than ignoring an entrenched culture. 

Existing departments are likely to include faculty at vari- 
ous stages in their careers. Most chairs will have the oppor- 
tunity to hire some new faculty and to work with some 
recent hires striving for tenure, some midcareer faculty, and 
some senior faculty. Among these groups, chairs will find 
some enthusiastic faculty, some apathetic faculty, some stars, 
some duds, some hitter and hostile faculty, and some highly 
respected “gatekeeper" faculty. A wise chair will take time to 
learn who belongs to which category and develop strategies 
for involving each cluster in the development of a culture 
that values excellent teaching: the foolish one who neglects 
the needs of these groups will fail. The following sugges- 
tions will help chairs collaborate with all faculty, especially 
new faculty, influential or gatekeeper facility, and burnt-out 
or hostile faculty. 

Using rewards to improve teaching 

Organizations tend to rely heavily on rewards 10 motivate 
workers. In higher education, however, rewards, although 
potentially effective, are often given to too few too rarely 
and consequently often become disincentives. Chairs at most 
institutions have very few rewards — tenure, promotion, and 
perhaps merit pay — they can dispense. The opportunity to 
award tenure comes once. The opportunity to award promo- 
tion comes at most three times. Consequently, these type of 
rewards are likely to have little effect on a faculty member's 
motivation. 

Merit pay provokes passionate reactions among faculty 
and could work against the collegia I ity necessary for a cul- 
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ture of excellence in teaching to flourish in a department. 
"On some — perhaps many — campuses, merit pay tends to 
promote a decline in faculty collegiality and an increase in 
faculty hostility” (Altman 1993, p. 31). Moreover, because 
merit pay tends to reward recent behaviors over long-term 
behaviors, any changes motivated by merit pay could turn 
out to be short-lived phenomena. And “research studies 
have demonstrated that when you are rewarded for what 
you previously did for fun. you are less likely to choose that 
activity when the rewards cease. You come to expect that 
you should be paid” (McKeaehie 1979. pp. -1—5). 

Although chairs may not be able to give out large re- 
wards. they may have smaller incentives at their disposal, 
and they should consider using them to encourage excel- 
lence in teaching. Often a small gesture coming from the 
right person at the right time is more appreciated than a 
“large” reward. An extremely effective and cost -conscious 
reward is simply recognition of accomplishments (Altman 
1993; Lucas 1994: Pendleton-Parkcr and Parker 1993). Chairs 
should make every effort to see that faculty are recognized 
for their efforts, within both the department and the institu- 
tion. A simple note of congratulations — perhaps with a copy 
on a departmental bulletin hoard — often pleases people. 
When a student compliments a departmental member s 
teaching, ask the student to write a short note to that effect 
and pass it on. Everyone likes to know that his or her 
accomplishments are valued. 

Chairs often have a small pot of money available for their 
own travel or incidental departmental expenses. They could 
consider providing faculty with additional travel funds — 
especially for attending conferences dealing with teaching in 
higher education (Allman 1993: Lucas 199 1). Chairs could 
also pay dues to professional organizations that promote 
leaching and for subscriptions to professional journals that 
deal with teaching and learning ( Pendlcton-Parkcr and 
Parker 1993). (See Cashin and Clegg 199* for a comprehen- 
sive list of both general and discipline-specific professional 
journals related to teaching.) 

Chairs might consider providing faculty who work to 
improve their teaching with additional clerical assistance in 
the form of a graduate assistant (Altman 1993) or a work- 
study student. Because faculty's most vocal complaint often 
involves parking, chairs might want to consider asking the 
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administration to designate a free parking space to the “pro- 
fessor of the month" (Altman 1993). The chair might want to 
use some budget money to take a faculty member to lunch 
or even invite the faculty member and spouse to dinner. 

An unusual and tantalizing suggestion is that departments 
create in-house visiting lecturers (Bevan 1985). By selecting 
one of their own to be a resource person for others, faculty 
recognize that person’s contributions to the department. The 
chair may wish to make a faculty member widely respected 
for his or her teaching ability a "visiting" teacher for a se- 
mester. In return for a reduced teaching load, that person 
could guest in other's classes. It would not only reward the 
guest lecturer, but also provide other faculty with a role 
model. Chairs could provide some faculty with an internal 
sabbatical leave (Altman 1993). which could be useful to a 
faculty member trying to develop a new teaching strategy. 

An internal sabbatical leave could also be useful to a faculty 
member who needs to prepare publications for tenure or 
promotion but who has neglected research for teaching. 

Some (including one of the anonymous reviewers of this 
manuscript) have suggested that chairs use their power to 
assign office space, courses, classrooms, anti class meeting 
times for rewarding deserving faculty. Using such environ- 
mental conditions to reward some, however, will likely 
breed resentment in others, and rather than appearing to 
reward the deserving, such actions could seem like punish- 
ment to those deemed undeserving. In this case, it will be 
difficult, if not impossible, to build the desired collegiaiity. 

Rewards are effective for faculty who are already doing 
an excellent job. but chairs also find it necessary to motivate 
faculty who are less enthusiastic about their teaching. Setting 
goals is an effective strategy for working with faculty ai any 
stage of a career (Lucas 199 0. and setting specific goals can 
be a compelling motivator (Latham and Yukl 1975). When 
the individual accepts them, the more difficult the goal, the 
greater the likelihood that it will he accomplished (Mcnto. 
Steel, and Karrcn 1987). Moreover, setting difficult goals 
and providing feedback on the individual’s progress to- 
ward meeting the goals increases effect ive ness (with sell- 
generated feedback more effective than feedback from 
others llvanccvich and McMahon 19821). When it conies to 
whether setting goals is more effec tive when the goals arc* 
established by the fac ulty member, by the chair, or mutually 



9i’ 



SiulvssJuI I'aculty IMvlnfnncnt <nul fivahutthm 



103 






by both, the research literature is decidedly undecided (Rob- 
bins 1989). Several factors suggest, however, that when 
dealing with academic professionals, the process of setting 
goals should be participative. First, the probability of difficult 
goals' being attained is definitely increased when the faculty 
member accepts the goal. Second, professors expect and 
demand a great deal of autonomy in determining the con- 
duct of their work. Third, the academy has a long tradition 
of participation in governance; therefore, it is much more 
probable that goals selected with the advice and consent of 
the faculty member will be attained. 

Mutually determined goals also enhance the opportunity 
to become the self-directed, reflective practitioners teaching 
portfolios provide. “To develop goals and action steps, indi- 
viduals become reflective practitioners and devote energy to 
thinking about a direction for their lives" (Lucas 1994, p. 84). 
One of the greatest advantages of teaching portfolios is that 
they place control of one s professional life in one's own 
hands. In other words, they empower faculty to become 
professional educators and to define it in their own terms. 
Setting goals and measuring success in attaining them 
through use of a teaching portfolio enables one to take 
charge of his or her life. 

The role of the chair in setting goals is to delineate clearly 
departmental and institutional expectations. The chair 
should also assist faculty in making goals realistic, concrete, 
and measurable (Lucas 199 1 ). If faculty are to succeed, they 
must set attainable goals. Idealistic faculty — particularly new 
faculty (Hoice 1991) — often believe that they can attain 
much more than circumstances allow. Faculty need to set 
goals that can he measured; vague goals create complacency 
and disillusionment. A goal to increase scholarly productiv- 
ity" is much more likely to go unmet than a goal "to submit 
one manuscript by the end of the semester." A goal "to use 
cooperative learning techniques more often" is much more 
likely to go unmet than a goal "to develop and test five 
cooperative learning assignments before the end of the 
semester." Moreover, the successful attainment of that goal 
w ill motivate the faculty to achieve oihei goals. 

Chairs should assist faculty by enabling self-monitored 
feedback. They might consider providing the faculty mem- 
ber with a self-evaluation checklist that breaks goals down 
into logical steps. As individuals are motivated by success. - 
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each time a faculty member can note that he or she accom- 
plished one of the steps, the feeling of successful accom- 
plishment will motivate him or her to start the next step. 

A critical step in developing a culture that promotes ex- 
cellence in teaching is to establish an atmosphere of colle- 
gialu, . Collegiality depends heavily on trust, and trust starts 
with communication. “Lack of information provokes charges 
of not being consulted or of being manipulated, resulting in 
failure to enlist sufficient faculty and administrative support" 
(Bevan 1985, p. 55). Chairs can begin to create an atmo- 
sphere of trust by communicating everything that is not con- 
fidential (Pendleton-Parker and Parker 1993). Several 
research studies demonstrate that department members 
value being kept informed very highly even when the infor- 
mation does not seem to directly affect them (J.P. Murray 
1992). For comprehensive communications to occur, chairs 
should maintain an open-door policy — although simply say- 
ing that your door is always open is not enough. The chair 
must be a sincere listener and must act upon faculty mem- 
bers* requests — even if the only action is to tell them that no 
action is possible (Pendleton-Parker and Parker 1993). And 
the chair cannot wait for faculty to come to his or her office: 
A chair must make certain to visit faculty (especially difficult 
faculty) in their offices ( Bevan 1985; Boice 1993). 

Faculty expect department chairs to communicate depart- 
mental needs to higher-level administrators. Faculty aLo 
sincerely value chairs who actively promote the depart- 
ment’s and faculty members’ accomplishments to higher- 
level administrators (Bevan 1985; J.P. Murray 1992, 
Pendleton-Parker and Parker 1993). 

Effective communications form the foundation to build a 
departmental culture that values excellence in teaching. 
Teaching will never be highly valued unless colleges and 
universities develop a culture where teaching becomes what 
Shulnian calls "community property” and we create what 
Palmer calls “good talk about good teaching’’ (Astin 1993: 

J. Davis 199-1: Edgerton 1993: Lucas 199*4: Palmer 1993: 
Shulman 1993). Chairs must take the leadership in creating 
this culture. 

Chairs can begin the good talk by setting time aside in 
every departmental meeting to discuss teaching (Lucas 
1994). Rather than have such a discussion follow some con- 
tentious agenda item, it is probably more effective to start 
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the meeting with a discussion of teaching. Chairs may want 
to consider setting aside one meeting a month or a semester 
to discuss nothing but issues related to teaching and curric- 
ula ( Pendlet on-Pa rker and Parker 1993)- They may want to 
set up workshops on teaching (Lucas 199*1). which could 
take the form of a faculty member's presentation on an in- 
novation he or she found successful or the results of a class- 
room research project. A faculty member might want to 
research a teaching topic and present his or her findings — 
which can he quite effective when a faculty member identi- 
fies a weakness in his or her teaching and sets out to 
research solutions. To facilitate such efforts, chairs should 
consider setting up a departmental library that includes 
hooks on improving the effectiveness of teaching and 
new sletters about teaching. 

Part of the ‘good talk about good teaching" requires 
chairs to get teaching colleagues to discuss each other s 
teaching. A chair might consider setting up a committee on 
the improvement of teaching that could assist the chair in 
creating a climate where faculty feel comfortable seeking 
help with teaching from one another and visiting one 
another's classes. To set the example, chairs should consider 
inviting faculty to observe and comment on their classes 
l Lucas 199-0. Chairs may wish to recruit some of the best 
teachers to start the project. 

Chairs who w ish to encourage excellence in teaching can 
encourage faculty to present at and or attend conferences 
dealing with teaching or at discipline conferences that spon- 
sor teaching-related sessions. They can do so by circulating 
calls for papers and conference registration materials to fac- 
ulty. Chairs might want to consider a bulletin hoard dedi- 
cated to teaching-related publications and conferences. A 
computer bulletin hoard and ora voice-mail distribution list 
can also he* quite effective means of promoting teaching- 
related conferences. 

Chairs will find some faculty who have the respect of 
their departmental colleagues and tend to act as “gatekeep- 
ers." And they will find some difficult faculty who are embit- 
tered because of some real or imagined wrong. To succeed. 

( hairs should woo and win over both groups. Some ap- 
proaches are appropriate lor both groups, others for only 
one. Chairs wishing to encourage the development of teach- 
ing portfolios as a means of improving teaching would he 
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wise to solicit a small number of the gatekeepers who also 
have reputations for being excellent teachers to experiment 
with and develop model teaching portfolios. 

Hiring new faculty 

Chairs can have the greatest effect on a department s culture 
by exercising their influence in the hiring of new faculty. 
When hiring new faculty, it is important to determine the fit 
between the candidate and the institution (Pendleton-Parker 
and Parker 1993). Some departmental cultures could cause a 
potential "star" to quickly bum out and self-destruct. A new 
hire will have little opportunity to thrive in a department 
with a cynical and bitter culture of personal rivalries. A new 
faculty member hired because of his or her potential to 
become an excellent teacher may fail to achieve tenure in a 
department that values research. “Pit" involves the aspira- 
tions of both the department and the candidate. 

To create a culture that expects excellence in teaching, 
chairs need to stress the importance of good teaching during 
the process of interviewing candidates. A chair wishing to 
emphasize the importance of teaching should ask potential 
candidates to provide evidence of excellence in teaching, 
and finalists should be asked to teach a class or two during 
their interview '(Lucas 1994). Although observing a candidate 
teach can help a committee make a decision, the classes 
should have real students and the candidate should be given 
ample time to prepare. It is highly unlikely that candidates 
will do their best if they are ill-informed about what students 
are studying. 

Once a new faculty member is hired, the chair should 
make certain that the faculty member has even* chance to 
succeed. Often in higher education, we simply tell new fac- 
ulty what course they are to teach and where they meet. 
Research on how new faculty acclimate to tl. »ir roles clearly 
shows that providing mentoring, especially inlbi.iial and 
voluntary, is very effective (Lucas 199*1: Pendleton-Parker 
and Parker 1993). Chairs wishing to encourage new faculty 
to become excellent teachers should consider pairing them 
with senior faculty who hav e earned reputations for excel- 
lence in teaching. New faculty should not become reliant on 
a single senior faculty member to the exclusion of other 
departmental members, however ( Pendleton-Parker and 
Parker 1993). 
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Chairs should develop an ongoing relationship with new 
faculty. “Have as much chair/new faculty contact and evalu- 
ation — even if only informal over coffee or a beer — as possi- 
ble: make sure hard decisions never come as a surprise" 
(Pendleton-Parker and Parker 1993. p. 205). Chairs can assist 
new faculty in adjusting their expectations to the reality of 
the department and the institution. Research demonstrates 
that most new faculty have unrealistic expectations about 
how to balance the demands of teaching and research 
(Boice 1991). At first, most new faculty tend to underesti- 
mate the amount of time teaching will take, and they often 
find it necessary to adjust and tend to overcompensate by 
spending too much time in preparation. Overpreparing, 
however, exacerbates the problem and causes new faculty 
to rely on dysfunctional teaching strategies. 

New faculty who have realistic expectations exhibit a 
willingness to seek help from colleagues and instructional 
development specialists (Boice 1991): therefore, chairs may 
wish to make new faculty aware of the instructional devel- 
opment resources available on campus. 

Dealing with difficult faculty 

Chairs report that dealing with difficult faculty takes up a 
great deal of time and that their efforts are usually unsuccess- 
ful (Boice 1993: Lucas 199-0. Once they have been estab- 
lished in a department, teaching portfolios offer an excel- 
lent vehicle for refocusing a faculty member on teaching. By 
encouraging a difficult faculty member to develop a portfolio, 
the chair can cause the individual to focus on teaching while 
also respecting the individual s autonomy. Moreover, the chair 
can communicate the message to the faculty member that he 
or she is a valuable contributor to the department. In some 
cases, that communication may be enough to bring the per- 
son back to the dedication to and enthusiasm for teaching he 
or she had at the start of the career. 

Most chairs do not know what to do for difficult faculty 
members and tend to try to ignore the situation (Lucas 
199*0. Ignoring the situation, however, almost never suc- 
ceeds. because it only heightens the individual's sense that 
he or she is being treated unjustly (Boice 1993). An effective 
solution is for chairs to "reach out to alienated members on 
a human level" (Lucas 199*1. p- 92): simply being friendly 
and courteous to difficult faculty members could win them 




over (Boice 1993; Lucas 1994). The chair could make it a 
point to seek out difficult faculty members for small talk. 
Once contact at a human level is established, the chair then 
asks the faculty member why he or she is withdrawn and 
what it would take to motivate him or her to change. If rap- 
port has been established, faculty members will he forth- 
coming. and the chair should ‘‘be prepared ... to agree to 
some extent with the content of their complaints and criti- 
cisms” (Boice 1993- p. 133). The next step is to negotiate 
goals or a growth contract that is to result in changed behav- 
ior. When the effort is sincere, chairs report a “better rela- 
tionship with the difficult faculty member, the individual's 
getting more involved or accepting more responsibility in 
the department, and the individual s making fewer abrasive 
comments at meetings" (Lucas 1994, p. 94). 

Several other approaches are available to chairs working 
with difficult faculty members. The chair may request the 
difficult faculty member to team teach a course (Lucas 1994), 
which can be an effective way to introduce burned-out fac- 
ulty to new teaching techniques. To work, however, chairs 
must assign their best teachers to team with those they want 
to help, and they must adjust teaching loads in a way that 
does not add to either team member's workload (usually by 
counting a team-taught class the same as an individually 
taught class). Hxchangc programs with nearby colleges and 
universities have been effective in introducing new ideas to 
a faculty with little turnover (J.P. Murray 1995a). and they 
can be especially effective with disgruntled or burned-out 
faculty (Lucas 1994). 

Summary 

If colleges and universities wish to alter their culture to 
value excellence in teaching, they must start with the depart- 
ment chair. It is no exaggeration to say that the quality of an 
institution depends directly on the quality of its department 
chairs. Effective department chairs facilitate the creation and 
promotion of a departmental vision. To accomplish it. chairs 
must be effective communicators and consensus builders. 
Chairs must learn to assist new faculty in learning their roles 
and find ways to help embittered and withdrawn faculty to 
once again become productive teachers. Both tasks require 
chairs to become creative in the ways they work with and 
reward faculty. 
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CONCLUSION 



This monograph has argued that teaching portfolios are a 
means of effectively evaluating and improving teaching in 
higher education. The improvement of teaching and learning 
is a worthwhile objective if for no other reason than the 
moral obligation colleges and universities have to provide a 
quality education to their students. The improvement of 
teaching and learning is made ail the more imperative by 
the increasing public cynicism over the value of a college 
education. College and university leaders are spending enor- 
mous amounts of time and energy fending off public criti- 
cism of the academy. In many cases, these criticisms are 
coming from legislators who can and have reduced funding 
to public colleges and universities. 

A large part of the criticism stems from the belief that stu- 
dents, parents, and taxpayers are simply not getting their 
money’s worth from higher education. While academic lead- 
ers can and do dismiss this concern as being a v ulgar preoc - 
cupation with consumerism, these attacks have an effect. 
Moreover, it is perhaps true that colleges and universities have 
strayed from their mission as educational institutions. This 
monograph has argued that by introducing leaching portfo- 
lios, colleges and universities can not only rediscover their 
historical mission but also convince the public that higher 
education deserves the support it has traditionally enjoyed. 

It is difficult to define teaching portfolios succinctly be- 
cause the definition depends on the intended use, which 
varies. Colleges and universities have used teaching portfo- 
lios to meet four different needs. Portfolios can document 
excellence in teaching, empower professors to define quality 
teaching in their own terms, allow colleges and universities 
to demonstrate that teaching is an institutional priority, and 
individualize faculty development. 

Because teaching portfolios allow individual faculty mem- 
bers to tailor the assessment of teaching and learning to 
their own beliefs, the content varies from one professor to 
another. It is important, however, that the minimum content 
be specified when portfolios are intended to be used for 
summalive ev aluation. Moreover, teaching portfolios should 
contain a statement of the professor's philosophy of leach- 
ing. The philosophical beliefs one holds consciously and 
unconsciously influence one's behavior. A professor's Ivliefs 
about the teaching and learning process directly inlluetice 
his or her demeanor in the classroom, treatment of students. 
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choices of teaching strategies, choices of assessment strate- 
gies, beliefs about grading, and so on. Unless these beliefs 
are made explicit, professors may never examine the validity 
of their beliefs and hence the value of their practices. 

Because portfolios contain both quantitative and qualita- 
tive materials, they allow evaluators to get a view of a pro- 
fessor’s teaching in the actual context of that teaching. Port- 
folios present a deeply woven, multilayered, richly varied 
picture of a professor s accomplishments in teaching. Be- 
cause the context of teaching is firmly and inextricably inter- 
woven throughout a teaching portfolio, its evaluation 
presents some specific challenges to campus administrators. 
These opportunities are analogous to the challenges that 
tenure and promotion committees grapple with when at- 
tempting to judge the quality of publications, teaching mate- 
rials. syllabi, and so on. The key is to develop valid, reliable, 
and fair procedures and standards that fit with the institu- 
tion's mission. 

The essence of a teaching portfolio is the assessment of 
the teaching/learning process. Assessment requires that fac- 
ulty gather data from self, students, and colleagues, which 
can be done through a variety of formal and informal ways. 
Gathering and analyzing data is a necessary, but not a suf- 
ficient, condition for reaching portfolios ro impact one s 
teaching. For the data to affect teaching, one needs to reflect 
on what the data reveal about his or her teaching. 

If teaching portfolios are to lie used to improve teaching, 
campuses must define what they mean by “good teaching.” 
file literature provides many and varied definitions — some 
contradicting others — because the definition of teaching de- 
pends a great deal on the institution's mission, the disci- 
pline, and the level of students' interest and preparation. But 
merely engaging a campus faculty in the discussion of how 
to define good teaching will have salutary benefits. Such dis- 
cussion forces many to think about teaching in new ways, 
maybe for the first time. 

'Ill is monograph has argued that higher education must 
undergo a cultural shift and become once again institutions 
that place leaching at the center of their being. If higher 
education s leaders shrink from this responsibility, it will he 
done for them by individuals much less qualified. The 
attacks on higher education are unlikely to subside if ig- 
nored. in part because society now believes higher educa- 
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tion is the best ticket — maybe the only ticket — to a decent 
quality of life for their children and themselves. Even if the 
external pressures would disappear tomorrow, higher edu- 
cation should look at how its mission has become ambigu- 
ous and take this opportunity to refocus itself. Higher edu- 
cation should first and foremost r>e an educational organiza- 
tion, which means celebrating teaching and learning, leach- 
ing portfolios are one means to accomplish that task. 
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Since 1983, the Association for the Study of Higher Educa- 
tion (ASHE) and the Educational Resources Information 
Center (ERIC) Clearinghouse on Higher Education, a spon- 
sored project of the Graduate School of Education and 
Human Development at The George Washington University, 
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